2023-07-22 22:06:04,801 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-22 22:06:05,052 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1 2023-07-22 22:06:05,052 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-22 22:06:05,094 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-22 22:06:05,340 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-22 22:06:05,341 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622, deleteOnExit=true 2023-07-22 22:06:05,341 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-22 22:06:05,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/test.cache.data in system properties and HBase conf 2023-07-22 22:06:05,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/hadoop.tmp.dir in system properties and HBase conf 2023-07-22 22:06:05,343 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/hadoop.log.dir in system properties and HBase conf 2023-07-22 22:06:05,344 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-22 22:06:05,344 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-22 22:06:05,344 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-22 22:06:05,724 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-22 22:06:05,733 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-22 22:06:05,733 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-22 22:06:05,734 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-22 22:06:05,734 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 22:06:05,735 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-22 22:06:05,735 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-22 22:06:05,736 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 22:06:05,736 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 22:06:05,737 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-22 22:06:05,737 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/nfs.dump.dir in system properties and HBase conf 2023-07-22 22:06:05,737 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/java.io.tmpdir in system properties and HBase conf 2023-07-22 22:06:05,738 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 22:06:05,738 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-22 22:06:05,739 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-22 22:06:06,325 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-22 22:06:06,328 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-22 22:06:06,604 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-22 22:06:06,760 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-22 22:06:06,774 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:06,820 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:06,857 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/java.io.tmpdir/Jetty_localhost_39811_hdfs____ato8v0/webapp 2023-07-22 22:06:07,007 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39811 2023-07-22 22:06:07,048 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-22 22:06:07,048 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-22 22:06:07,542 WARN [Listener at localhost/37905] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 22:06:07,649 WARN [Listener at localhost/37905] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 22:06:07,675 WARN [Listener at localhost/37905] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:07,685 INFO [Listener at localhost/37905] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:07,694 INFO [Listener at localhost/37905] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/java.io.tmpdir/Jetty_localhost_43963_datanode____5ewpby/webapp 2023-07-22 22:06:07,839 INFO [Listener at localhost/37905] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43963 2023-07-22 22:06:08,482 WARN [Listener at localhost/40185] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 22:06:08,519 WARN [Listener at localhost/40185] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 22:06:08,525 WARN [Listener at localhost/40185] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:08,527 INFO [Listener at localhost/40185] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:08,537 INFO [Listener at localhost/40185] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/java.io.tmpdir/Jetty_localhost_37411_datanode____i64y1j/webapp 2023-07-22 22:06:08,677 INFO [Listener at localhost/40185] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37411 2023-07-22 22:06:08,698 WARN [Listener at localhost/41211] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 22:06:08,754 WARN [Listener at localhost/41211] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 22:06:08,760 WARN [Listener at localhost/41211] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:08,762 INFO [Listener at localhost/41211] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:08,769 INFO [Listener at localhost/41211] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/java.io.tmpdir/Jetty_localhost_44033_datanode____ar9ddj/webapp 2023-07-22 22:06:08,977 INFO [Listener at localhost/41211] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44033 2023-07-22 22:06:09,001 WARN [Listener at localhost/34823] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 22:06:09,255 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe31c907b3d6eb4d: Processing first storage report for DS-6087049d-88f2-4c88-850b-2978852aaf15 from datanode 87b7aec1-b2d0-4be5-9bcf-9ed6f51b96f9 2023-07-22 22:06:09,257 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe31c907b3d6eb4d: from storage DS-6087049d-88f2-4c88-850b-2978852aaf15 node DatanodeRegistration(127.0.0.1:44523, datanodeUuid=87b7aec1-b2d0-4be5-9bcf-9ed6f51b96f9, infoPort=36967, infoSecurePort=0, ipcPort=41211, storageInfo=lv=-57;cid=testClusterID;nsid=279970971;c=1690063566396), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-22 22:06:09,257 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8f3715aceba93374: Processing first storage report for DS-31a51825-9ad1-402f-b04c-ee5b9c698996 from datanode df5246b2-6ce8-4e35-84e7-e3ae84d67eed 2023-07-22 22:06:09,258 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8f3715aceba93374: from storage DS-31a51825-9ad1-402f-b04c-ee5b9c698996 node DatanodeRegistration(127.0.0.1:46391, datanodeUuid=df5246b2-6ce8-4e35-84e7-e3ae84d67eed, infoPort=33407, infoSecurePort=0, ipcPort=40185, storageInfo=lv=-57;cid=testClusterID;nsid=279970971;c=1690063566396), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 22:06:09,258 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe31c907b3d6eb4d: Processing first storage report for DS-df7f3d84-83e0-44f5-b18a-64996bfbf919 from datanode 87b7aec1-b2d0-4be5-9bcf-9ed6f51b96f9 2023-07-22 22:06:09,258 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe31c907b3d6eb4d: from storage DS-df7f3d84-83e0-44f5-b18a-64996bfbf919 node DatanodeRegistration(127.0.0.1:44523, datanodeUuid=87b7aec1-b2d0-4be5-9bcf-9ed6f51b96f9, infoPort=36967, infoSecurePort=0, ipcPort=41211, storageInfo=lv=-57;cid=testClusterID;nsid=279970971;c=1690063566396), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 22:06:09,258 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8f3715aceba93374: Processing first storage report for DS-0bbe88bd-8a7c-4853-9314-81b99530bc82 from datanode df5246b2-6ce8-4e35-84e7-e3ae84d67eed 2023-07-22 22:06:09,259 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8f3715aceba93374: from storage DS-0bbe88bd-8a7c-4853-9314-81b99530bc82 node DatanodeRegistration(127.0.0.1:46391, datanodeUuid=df5246b2-6ce8-4e35-84e7-e3ae84d67eed, infoPort=33407, infoSecurePort=0, ipcPort=40185, storageInfo=lv=-57;cid=testClusterID;nsid=279970971;c=1690063566396), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-22 22:06:09,278 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc7d38674fc48283d: Processing first storage report for DS-d7ab88a7-c11b-49c0-8bfe-a2bd41df9157 from datanode 1d9eb9cd-fa14-46b3-b94e-0261e6fd1e66 2023-07-22 22:06:09,279 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc7d38674fc48283d: from storage DS-d7ab88a7-c11b-49c0-8bfe-a2bd41df9157 node DatanodeRegistration(127.0.0.1:34585, datanodeUuid=1d9eb9cd-fa14-46b3-b94e-0261e6fd1e66, infoPort=34959, infoSecurePort=0, ipcPort=34823, storageInfo=lv=-57;cid=testClusterID;nsid=279970971;c=1690063566396), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-22 22:06:09,279 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc7d38674fc48283d: Processing first storage report for DS-37b32d04-5d85-4b63-a5a3-623327afc376 from datanode 1d9eb9cd-fa14-46b3-b94e-0261e6fd1e66 2023-07-22 22:06:09,279 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc7d38674fc48283d: from storage DS-37b32d04-5d85-4b63-a5a3-623327afc376 node DatanodeRegistration(127.0.0.1:34585, datanodeUuid=1d9eb9cd-fa14-46b3-b94e-0261e6fd1e66, infoPort=34959, infoSecurePort=0, ipcPort=34823, storageInfo=lv=-57;cid=testClusterID;nsid=279970971;c=1690063566396), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 22:06:09,551 DEBUG [Listener at localhost/34823] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1 2023-07-22 22:06:09,640 INFO [Listener at localhost/34823] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622/zookeeper_0, clientPort=64066, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-22 22:06:09,659 INFO [Listener at localhost/34823] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64066 2023-07-22 22:06:09,667 INFO [Listener at localhost/34823] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:09,669 INFO [Listener at localhost/34823] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:10,385 INFO [Listener at localhost/34823] util.FSUtils(471): Created version file at hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 with version=8 2023-07-22 22:06:10,385 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/hbase-staging 2023-07-22 22:06:10,763 INFO [Listener at localhost/34823] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-22 22:06:11,457 INFO [Listener at localhost/34823] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 22:06:11,493 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:11,493 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:11,494 INFO [Listener at localhost/34823] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 22:06:11,494 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:11,494 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 22:06:11,658 INFO [Listener at localhost/34823] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 22:06:11,736 DEBUG [Listener at localhost/34823] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-22 22:06:11,839 INFO [Listener at localhost/34823] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33185 2023-07-22 22:06:11,853 INFO [Listener at localhost/34823] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:11,856 INFO [Listener at localhost/34823] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:11,880 INFO [Listener at localhost/34823] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33185 connecting to ZooKeeper ensemble=127.0.0.1:64066 2023-07-22 22:06:11,937 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:331850x0, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 22:06:11,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33185-0x1018f1205d20000 connected 2023-07-22 22:06:11,979 DEBUG [Listener at localhost/34823] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 22:06:11,980 DEBUG [Listener at localhost/34823] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:06:11,993 DEBUG [Listener at localhost/34823] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 22:06:12,000 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33185 2023-07-22 22:06:12,001 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33185 2023-07-22 22:06:12,001 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33185 2023-07-22 22:06:12,002 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33185 2023-07-22 22:06:12,002 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33185 2023-07-22 22:06:12,012 INFO [Listener at localhost/34823] master.HMaster(444): hbase.rootdir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3, hbase.cluster.distributed=false 2023-07-22 22:06:12,105 INFO [Listener at localhost/34823] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 22:06:12,105 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,105 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,105 INFO [Listener at localhost/34823] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 22:06:12,106 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,106 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 22:06:12,113 INFO [Listener at localhost/34823] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 22:06:12,117 INFO [Listener at localhost/34823] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38207 2023-07-22 22:06:12,120 INFO [Listener at localhost/34823] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 22:06:12,129 DEBUG [Listener at localhost/34823] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-22 22:06:12,130 INFO [Listener at localhost/34823] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:12,132 INFO [Listener at localhost/34823] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:12,134 INFO [Listener at localhost/34823] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38207 connecting to ZooKeeper ensemble=127.0.0.1:64066 2023-07-22 22:06:12,145 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:382070x0, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 22:06:12,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38207-0x1018f1205d20001 connected 2023-07-22 22:06:12,147 DEBUG [Listener at localhost/34823] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 22:06:12,149 DEBUG [Listener at localhost/34823] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:06:12,150 DEBUG [Listener at localhost/34823] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 22:06:12,158 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38207 2023-07-22 22:06:12,159 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38207 2023-07-22 22:06:12,159 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38207 2023-07-22 22:06:12,162 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38207 2023-07-22 22:06:12,163 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38207 2023-07-22 22:06:12,180 INFO [Listener at localhost/34823] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 22:06:12,180 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,181 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,181 INFO [Listener at localhost/34823] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 22:06:12,181 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,182 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 22:06:12,182 INFO [Listener at localhost/34823] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 22:06:12,184 INFO [Listener at localhost/34823] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36573 2023-07-22 22:06:12,184 INFO [Listener at localhost/34823] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 22:06:12,187 DEBUG [Listener at localhost/34823] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-22 22:06:12,188 INFO [Listener at localhost/34823] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:12,190 INFO [Listener at localhost/34823] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:12,193 INFO [Listener at localhost/34823] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36573 connecting to ZooKeeper ensemble=127.0.0.1:64066 2023-07-22 22:06:12,199 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:365730x0, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 22:06:12,200 DEBUG [Listener at localhost/34823] zookeeper.ZKUtil(164): regionserver:365730x0, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 22:06:12,201 DEBUG [Listener at localhost/34823] zookeeper.ZKUtil(164): regionserver:365730x0, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:06:12,202 DEBUG [Listener at localhost/34823] zookeeper.ZKUtil(164): regionserver:365730x0, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 22:06:12,203 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36573-0x1018f1205d20002 connected 2023-07-22 22:06:12,210 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36573 2023-07-22 22:06:12,211 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36573 2023-07-22 22:06:12,215 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36573 2023-07-22 22:06:12,215 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36573 2023-07-22 22:06:12,216 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36573 2023-07-22 22:06:12,233 INFO [Listener at localhost/34823] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 22:06:12,233 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,233 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,233 INFO [Listener at localhost/34823] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 22:06:12,233 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 22:06:12,234 INFO [Listener at localhost/34823] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 22:06:12,234 INFO [Listener at localhost/34823] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 22:06:12,235 INFO [Listener at localhost/34823] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34749 2023-07-22 22:06:12,236 INFO [Listener at localhost/34823] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 22:06:12,242 DEBUG [Listener at localhost/34823] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-22 22:06:12,244 INFO [Listener at localhost/34823] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:12,245 INFO [Listener at localhost/34823] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:12,246 INFO [Listener at localhost/34823] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34749 connecting to ZooKeeper ensemble=127.0.0.1:64066 2023-07-22 22:06:12,252 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:347490x0, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 22:06:12,252 DEBUG [Listener at localhost/34823] zookeeper.ZKUtil(164): regionserver:347490x0, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 22:06:12,254 DEBUG [Listener at localhost/34823] zookeeper.ZKUtil(164): regionserver:347490x0, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:06:12,254 DEBUG [Listener at localhost/34823] zookeeper.ZKUtil(164): regionserver:347490x0, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 22:06:12,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34749-0x1018f1205d20003 connected 2023-07-22 22:06:12,267 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34749 2023-07-22 22:06:12,268 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34749 2023-07-22 22:06:12,270 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34749 2023-07-22 22:06:12,275 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34749 2023-07-22 22:06:12,275 DEBUG [Listener at localhost/34823] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34749 2023-07-22 22:06:12,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33185,1690063570571 2023-07-22 22:06:12,294 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-22 22:06:12,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33185,1690063570571 2023-07-22 22:06:12,322 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 22:06:12,322 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 22:06:12,323 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 22:06:12,324 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 22:06:12,324 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:12,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-22 22:06:12,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-22 22:06:12,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33185,1690063570571 from backup master directory 2023-07-22 22:06:12,336 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33185,1690063570571 2023-07-22 22:06:12,336 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-22 22:06:12,337 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 22:06:12,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33185,1690063570571 2023-07-22 22:06:12,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-22 22:06:12,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-22 22:06:12,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/hbase.id with ID: 1926f1d7-5c28-4d31-88a2-37116f901e1b 2023-07-22 22:06:12,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 22:06:12,959 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:13,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3036fce1 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:13,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e7ca6fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:13,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 22:06:13,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-22 22:06:13,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-22 22:06:13,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-22 22:06:13,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-22 22:06:13,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-22 22:06:13,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 22:06:13,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/MasterData/data/master/store-tmp 2023-07-22 22:06:13,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:13,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-22 22:06:13,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:06:13,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:06:13,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-22 22:06:13,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:06:13,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:06:13,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 22:06:13,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/MasterData/WALs/jenkins-hbase4.apache.org,33185,1690063570571 2023-07-22 22:06:13,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33185%2C1690063570571, suffix=, logDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/MasterData/WALs/jenkins-hbase4.apache.org,33185,1690063570571, archiveDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/MasterData/oldWALs, maxLogs=10 2023-07-22 22:06:13,377 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44523,DS-6087049d-88f2-4c88-850b-2978852aaf15,DISK] 2023-07-22 22:06:13,377 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46391,DS-31a51825-9ad1-402f-b04c-ee5b9c698996,DISK] 2023-07-22 22:06:13,377 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34585,DS-d7ab88a7-c11b-49c0-8bfe-a2bd41df9157,DISK] 2023-07-22 22:06:13,385 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-22 22:06:13,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/MasterData/WALs/jenkins-hbase4.apache.org,33185,1690063570571/jenkins-hbase4.apache.org%2C33185%2C1690063570571.1690063573305 2023-07-22 22:06:13,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34585,DS-d7ab88a7-c11b-49c0-8bfe-a2bd41df9157,DISK], DatanodeInfoWithStorage[127.0.0.1:46391,DS-31a51825-9ad1-402f-b04c-ee5b9c698996,DISK], DatanodeInfoWithStorage[127.0.0.1:44523,DS-6087049d-88f2-4c88-850b-2978852aaf15,DISK]] 2023-07-22 22:06:13,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-22 22:06:13,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:13,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 22:06:13,486 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 22:06:13,577 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-22 22:06:13,585 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-22 22:06:13,620 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-22 22:06:13,636 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:13,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-22 22:06:13,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-22 22:06:13,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 22:06:13,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:13,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62021736, jitterRate=-0.07580411434173584}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:13,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 22:06:13,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-22 22:06:13,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-22 22:06:13,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-22 22:06:13,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-22 22:06:13,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-22 22:06:13,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 48 msec 2023-07-22 22:06:13,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-22 22:06:13,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-22 22:06:13,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-22 22:06:13,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-22 22:06:13,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-22 22:06:13,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-22 22:06:13,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-22 22:06:13,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-22 22:06:13,902 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:13,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-22 22:06:13,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-22 22:06:13,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-22 22:06:13,929 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 22:06:13,929 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 22:06:13,930 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 22:06:13,930 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 22:06:13,930 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:13,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33185,1690063570571, sessionid=0x1018f1205d20000, setting cluster-up flag (Was=false) 2023-07-22 22:06:13,961 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:13,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-22 22:06:13,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33185,1690063570571 2023-07-22 22:06:13,989 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:13,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-22 22:06:14,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33185,1690063570571 2023-07-22 22:06:14,008 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp 2023-07-22 22:06:14,094 INFO [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer(951): ClusterId : 1926f1d7-5c28-4d31-88a2-37116f901e1b 2023-07-22 22:06:14,095 INFO [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(951): ClusterId : 1926f1d7-5c28-4d31-88a2-37116f901e1b 2023-07-22 22:06:14,105 INFO [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(951): ClusterId : 1926f1d7-5c28-4d31-88a2-37116f901e1b 2023-07-22 22:06:14,112 DEBUG [RS:2;jenkins-hbase4:34749] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 22:06:14,112 DEBUG [RS:1;jenkins-hbase4:36573] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 22:06:14,112 DEBUG [RS:0;jenkins-hbase4:38207] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 22:06:14,128 DEBUG [RS:2;jenkins-hbase4:34749] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 22:06:14,128 DEBUG [RS:2;jenkins-hbase4:34749] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 22:06:14,128 DEBUG [RS:1;jenkins-hbase4:36573] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 22:06:14,128 DEBUG [RS:0;jenkins-hbase4:38207] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 22:06:14,128 DEBUG [RS:1;jenkins-hbase4:36573] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 22:06:14,133 DEBUG [RS:2;jenkins-hbase4:34749] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 22:06:14,128 DEBUG [RS:0;jenkins-hbase4:38207] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 22:06:14,140 DEBUG [RS:2;jenkins-hbase4:34749] zookeeper.ReadOnlyZKClient(139): Connect 0x25b70c02 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:14,141 DEBUG [RS:1;jenkins-hbase4:36573] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 22:06:14,142 DEBUG [RS:0;jenkins-hbase4:38207] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 22:06:14,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-22 22:06:14,155 DEBUG [RS:1;jenkins-hbase4:36573] zookeeper.ReadOnlyZKClient(139): Connect 0x4cf5e2c4 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:14,191 DEBUG [RS:0;jenkins-hbase4:38207] zookeeper.ReadOnlyZKClient(139): Connect 0x527cf3c0 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:14,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:14,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-22 22:06:14,249 DEBUG [RS:2;jenkins-hbase4:34749] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@123a531c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:14,250 DEBUG [RS:2;jenkins-hbase4:34749] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6859c779, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 22:06:14,250 DEBUG [RS:1;jenkins-hbase4:36573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42d3c57b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:14,252 DEBUG [RS:0;jenkins-hbase4:38207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b2c0a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:14,254 DEBUG [RS:0;jenkins-hbase4:38207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51e6a87b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 22:06:14,254 DEBUG [RS:1;jenkins-hbase4:36573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d7a4ecc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 22:06:14,279 DEBUG [RS:0;jenkins-hbase4:38207] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38207 2023-07-22 22:06:14,281 DEBUG [RS:1;jenkins-hbase4:36573] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36573 2023-07-22 22:06:14,286 INFO [RS:0;jenkins-hbase4:38207] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 22:06:14,286 INFO [RS:1;jenkins-hbase4:36573] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 22:06:14,287 INFO [RS:0;jenkins-hbase4:38207] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 22:06:14,287 INFO [RS:1;jenkins-hbase4:36573] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 22:06:14,288 DEBUG [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 22:06:14,288 DEBUG [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 22:06:14,288 INFO [RS:1;jenkins-hbase4:36573] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:14,288 INFO [RS:0;jenkins-hbase4:38207] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:14,289 DEBUG [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 22:06:14,289 DEBUG [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 22:06:14,293 INFO [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33185,1690063570571 with isa=jenkins-hbase4.apache.org/172.31.14.131:38207, startcode=1690063572104 2023-07-22 22:06:14,293 INFO [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33185,1690063570571 with isa=jenkins-hbase4.apache.org/172.31.14.131:36573, startcode=1690063572179 2023-07-22 22:06:14,313 DEBUG [RS:2;jenkins-hbase4:34749] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:34749 2023-07-22 22:06:14,313 INFO [RS:2;jenkins-hbase4:34749] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 22:06:14,313 INFO [RS:2;jenkins-hbase4:34749] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 22:06:14,313 DEBUG [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 22:06:14,313 INFO [RS:2;jenkins-hbase4:34749] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:14,313 DEBUG [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 22:06:14,314 INFO [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33185,1690063570571 with isa=jenkins-hbase4.apache.org/172.31.14.131:34749, startcode=1690063572232 2023-07-22 22:06:14,315 DEBUG [RS:0;jenkins-hbase4:38207] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 22:06:14,317 DEBUG [RS:2;jenkins-hbase4:34749] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 22:06:14,315 DEBUG [RS:1;jenkins-hbase4:36573] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 22:06:14,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-22 22:06:14,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 22:06:14,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 22:06:14,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 22:06:14,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 22:06:14,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-22 22:06:14,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 22:06:14,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690063604368 2023-07-22 22:06:14,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-22 22:06:14,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-22 22:06:14,392 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-22 22:06:14,392 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-22 22:06:14,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-22 22:06:14,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-22 22:06:14,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-22 22:06:14,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-22 22:06:14,398 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 22:06:14,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,403 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58233, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 22:06:14,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-22 22:06:14,403 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53439, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 22:06:14,404 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50259, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 22:06:14,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-22 22:06:14,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-22 22:06:14,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-22 22:06:14,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-22 22:06:14,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690063574414,5,FailOnTimeoutGroup] 2023-07-22 22:06:14,416 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33185] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-22 22:06:14,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690063574414,5,FailOnTimeoutGroup] 2023-07-22 22:06:14,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-22 22:06:14,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,439 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33185] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:14,445 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33185] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:14,453 DEBUG [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:06:14,453 DEBUG [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:06:14,454 DEBUG [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37905 2023-07-22 22:06:14,454 DEBUG [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37905 2023-07-22 22:06:14,454 DEBUG [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 22:06:14,454 DEBUG [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 22:06:14,476 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:06:14,476 DEBUG [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer(2830): Master is not running yet 2023-07-22 22:06:14,483 WARN [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-22 22:06:14,484 DEBUG [RS:1;jenkins-hbase4:36573] zookeeper.ZKUtil(162): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:14,484 DEBUG [RS:2;jenkins-hbase4:34749] zookeeper.ZKUtil(162): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:14,484 WARN [RS:1;jenkins-hbase4:36573] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 22:06:14,485 WARN [RS:2;jenkins-hbase4:34749] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 22:06:14,485 INFO [RS:1;jenkins-hbase4:36573] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 22:06:14,487 INFO [RS:2;jenkins-hbase4:34749] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 22:06:14,487 DEBUG [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/WALs/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:14,487 DEBUG [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/WALs/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:14,487 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36573,1690063572179] 2023-07-22 22:06:14,488 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34749,1690063572232] 2023-07-22 22:06:14,499 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-22 22:06:14,501 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-22 22:06:14,502 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:06:14,510 DEBUG [RS:2;jenkins-hbase4:34749] zookeeper.ZKUtil(162): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:14,510 DEBUG [RS:1;jenkins-hbase4:36573] zookeeper.ZKUtil(162): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:14,512 DEBUG [RS:2;jenkins-hbase4:34749] zookeeper.ZKUtil(162): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:14,512 DEBUG [RS:1;jenkins-hbase4:36573] zookeeper.ZKUtil(162): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:14,530 DEBUG [RS:2;jenkins-hbase4:34749] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 22:06:14,531 DEBUG [RS:1;jenkins-hbase4:36573] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 22:06:14,539 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:14,542 INFO [RS:1;jenkins-hbase4:36573] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 22:06:14,555 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-22 22:06:14,563 INFO [RS:2;jenkins-hbase4:34749] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 22:06:14,563 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/info 2023-07-22 22:06:14,565 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-22 22:06:14,566 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:14,566 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-22 22:06:14,575 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/rep_barrier 2023-07-22 22:06:14,575 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-22 22:06:14,577 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:14,577 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-22 22:06:14,579 INFO [RS:1;jenkins-hbase4:36573] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 22:06:14,584 INFO [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33185,1690063570571 with isa=jenkins-hbase4.apache.org/172.31.14.131:38207, startcode=1690063572104 2023-07-22 22:06:14,588 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/table 2023-07-22 22:06:14,589 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-22 22:06:14,590 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:14,579 INFO [RS:2;jenkins-hbase4:34749] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 22:06:14,595 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33185] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:14,595 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740 2023-07-22 22:06:14,597 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740 2023-07-22 22:06:14,599 DEBUG [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:06:14,600 DEBUG [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37905 2023-07-22 22:06:14,600 DEBUG [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 22:06:14,602 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:06:14,602 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:06:14,602 INFO [RS:1;jenkins-hbase4:36573] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 22:06:14,603 INFO [RS:1;jenkins-hbase4:36573] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,604 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38207,1690063572104] 2023-07-22 22:06:14,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:14,605 DEBUG [RS:0;jenkins-hbase4:38207] zookeeper.ZKUtil(162): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:14,605 WARN [RS:0;jenkins-hbase4:38207] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 22:06:14,605 INFO [RS:0;jenkins-hbase4:38207] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 22:06:14,605 DEBUG [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/WALs/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:14,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:14,606 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-22 22:06:14,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:14,608 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-22 22:06:14,611 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:06:14,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:14,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:14,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:14,614 INFO [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 22:06:14,603 INFO [RS:2;jenkins-hbase4:34749] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 22:06:14,619 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:14,617 INFO [RS:2;jenkins-hbase4:34749] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,619 INFO [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 22:06:14,620 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71599052, jitterRate=0.06690901517868042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-22 22:06:14,621 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-22 22:06:14,621 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-22 22:06:14,621 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-22 22:06:14,621 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-22 22:06:14,622 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-22 22:06:14,622 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-22 22:06:14,622 DEBUG [RS:0;jenkins-hbase4:38207] zookeeper.ZKUtil(162): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:14,623 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-22 22:06:14,623 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-22 22:06:14,628 INFO [RS:2;jenkins-hbase4:34749] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,628 DEBUG [RS:2;jenkins-hbase4:34749] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,628 DEBUG [RS:2;jenkins-hbase4:34749] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,628 DEBUG [RS:2;jenkins-hbase4:34749] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,629 DEBUG [RS:2;jenkins-hbase4:34749] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,629 DEBUG [RS:2;jenkins-hbase4:34749] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,629 DEBUG [RS:2;jenkins-hbase4:34749] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 22:06:14,629 DEBUG [RS:2;jenkins-hbase4:34749] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,629 DEBUG [RS:2;jenkins-hbase4:34749] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,629 DEBUG [RS:2;jenkins-hbase4:34749] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,629 DEBUG [RS:2;jenkins-hbase4:34749] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,631 DEBUG [RS:0;jenkins-hbase4:38207] zookeeper.ZKUtil(162): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:14,631 DEBUG [RS:0;jenkins-hbase4:38207] zookeeper.ZKUtil(162): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:14,632 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-22 22:06:14,632 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-22 22:06:14,633 DEBUG [RS:0;jenkins-hbase4:38207] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 22:06:14,633 INFO [RS:0;jenkins-hbase4:38207] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 22:06:14,634 INFO [RS:1;jenkins-hbase4:36573] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,635 DEBUG [RS:1;jenkins-hbase4:36573] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,635 DEBUG [RS:1;jenkins-hbase4:36573] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,636 DEBUG [RS:1;jenkins-hbase4:36573] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,636 DEBUG [RS:1;jenkins-hbase4:36573] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,636 DEBUG [RS:1;jenkins-hbase4:36573] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,636 DEBUG [RS:1;jenkins-hbase4:36573] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 22:06:14,636 DEBUG [RS:1;jenkins-hbase4:36573] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,636 DEBUG [RS:1;jenkins-hbase4:36573] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,636 DEBUG [RS:1;jenkins-hbase4:36573] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,636 DEBUG [RS:1;jenkins-hbase4:36573] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,658 INFO [RS:2;jenkins-hbase4:34749] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,678 INFO [RS:2;jenkins-hbase4:34749] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,678 INFO [RS:2;jenkins-hbase4:34749] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,677 INFO [RS:1;jenkins-hbase4:36573] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,678 INFO [RS:1;jenkins-hbase4:36573] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,678 INFO [RS:1;jenkins-hbase4:36573] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,664 INFO [RS:0;jenkins-hbase4:38207] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 22:06:14,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-22 22:06:14,698 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-22 22:06:14,705 INFO [RS:0;jenkins-hbase4:38207] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 22:06:14,705 INFO [RS:0;jenkins-hbase4:38207] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,714 INFO [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 22:06:14,718 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-22 22:06:14,722 INFO [RS:0;jenkins-hbase4:38207] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,722 DEBUG [RS:0;jenkins-hbase4:38207] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,723 DEBUG [RS:0;jenkins-hbase4:38207] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,723 DEBUG [RS:0;jenkins-hbase4:38207] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,723 DEBUG [RS:0;jenkins-hbase4:38207] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,723 DEBUG [RS:0;jenkins-hbase4:38207] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,723 DEBUG [RS:0;jenkins-hbase4:38207] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 22:06:14,723 DEBUG [RS:0;jenkins-hbase4:38207] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,724 DEBUG [RS:0;jenkins-hbase4:38207] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,724 DEBUG [RS:0;jenkins-hbase4:38207] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,724 INFO [RS:2;jenkins-hbase4:34749] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 22:06:14,724 DEBUG [RS:0;jenkins-hbase4:38207] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 22:06:14,729 INFO [RS:2;jenkins-hbase4:34749] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34749,1690063572232-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,730 INFO [RS:0;jenkins-hbase4:38207] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,730 INFO [RS:0;jenkins-hbase4:38207] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,730 INFO [RS:0;jenkins-hbase4:38207] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,735 INFO [RS:1;jenkins-hbase4:36573] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 22:06:14,735 INFO [RS:1;jenkins-hbase4:36573] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36573,1690063572179-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,749 INFO [RS:0;jenkins-hbase4:38207] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 22:06:14,749 INFO [RS:0;jenkins-hbase4:38207] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38207,1690063572104-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:14,753 INFO [RS:2;jenkins-hbase4:34749] regionserver.Replication(203): jenkins-hbase4.apache.org,34749,1690063572232 started 2023-07-22 22:06:14,753 INFO [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34749,1690063572232, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34749, sessionid=0x1018f1205d20003 2023-07-22 22:06:14,754 DEBUG [RS:2;jenkins-hbase4:34749] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 22:06:14,754 DEBUG [RS:2;jenkins-hbase4:34749] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:14,754 DEBUG [RS:2;jenkins-hbase4:34749] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34749,1690063572232' 2023-07-22 22:06:14,754 DEBUG [RS:2;jenkins-hbase4:34749] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 22:06:14,755 DEBUG [RS:2;jenkins-hbase4:34749] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 22:06:14,756 DEBUG [RS:2;jenkins-hbase4:34749] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 22:06:14,756 DEBUG [RS:2;jenkins-hbase4:34749] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 22:06:14,756 DEBUG [RS:2;jenkins-hbase4:34749] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:14,756 DEBUG [RS:2;jenkins-hbase4:34749] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34749,1690063572232' 2023-07-22 22:06:14,756 DEBUG [RS:2;jenkins-hbase4:34749] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:14,756 DEBUG [RS:2;jenkins-hbase4:34749] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:14,757 DEBUG [RS:2;jenkins-hbase4:34749] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 22:06:14,757 INFO [RS:2;jenkins-hbase4:34749] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 22:06:14,757 INFO [RS:2;jenkins-hbase4:34749] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 22:06:14,769 INFO [RS:1;jenkins-hbase4:36573] regionserver.Replication(203): jenkins-hbase4.apache.org,36573,1690063572179 started 2023-07-22 22:06:14,769 INFO [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36573,1690063572179, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36573, sessionid=0x1018f1205d20002 2023-07-22 22:06:14,769 DEBUG [RS:1;jenkins-hbase4:36573] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 22:06:14,769 DEBUG [RS:1;jenkins-hbase4:36573] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:14,770 DEBUG [RS:1;jenkins-hbase4:36573] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36573,1690063572179' 2023-07-22 22:06:14,771 DEBUG [RS:1;jenkins-hbase4:36573] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 22:06:14,771 INFO [RS:0;jenkins-hbase4:38207] regionserver.Replication(203): jenkins-hbase4.apache.org,38207,1690063572104 started 2023-07-22 22:06:14,771 INFO [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38207,1690063572104, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38207, sessionid=0x1018f1205d20001 2023-07-22 22:06:14,771 DEBUG [RS:0;jenkins-hbase4:38207] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 22:06:14,771 DEBUG [RS:0;jenkins-hbase4:38207] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:14,771 DEBUG [RS:0;jenkins-hbase4:38207] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38207,1690063572104' 2023-07-22 22:06:14,772 DEBUG [RS:1;jenkins-hbase4:36573] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 22:06:14,772 DEBUG [RS:0;jenkins-hbase4:38207] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 22:06:14,772 DEBUG [RS:1;jenkins-hbase4:36573] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 22:06:14,772 DEBUG [RS:1;jenkins-hbase4:36573] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 22:06:14,772 DEBUG [RS:0;jenkins-hbase4:38207] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 22:06:14,772 DEBUG [RS:1;jenkins-hbase4:36573] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:14,773 DEBUG [RS:1;jenkins-hbase4:36573] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36573,1690063572179' 2023-07-22 22:06:14,773 DEBUG [RS:1;jenkins-hbase4:36573] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:14,774 DEBUG [RS:1;jenkins-hbase4:36573] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:14,774 DEBUG [RS:1;jenkins-hbase4:36573] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 22:06:14,774 INFO [RS:1;jenkins-hbase4:36573] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 22:06:14,775 DEBUG [RS:0;jenkins-hbase4:38207] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 22:06:14,775 INFO [RS:1;jenkins-hbase4:36573] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 22:06:14,775 DEBUG [RS:0;jenkins-hbase4:38207] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 22:06:14,775 DEBUG [RS:0;jenkins-hbase4:38207] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:14,775 DEBUG [RS:0;jenkins-hbase4:38207] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38207,1690063572104' 2023-07-22 22:06:14,775 DEBUG [RS:0;jenkins-hbase4:38207] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:14,776 DEBUG [RS:0;jenkins-hbase4:38207] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:14,776 DEBUG [RS:0;jenkins-hbase4:38207] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 22:06:14,776 INFO [RS:0;jenkins-hbase4:38207] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 22:06:14,777 INFO [RS:0;jenkins-hbase4:38207] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 22:06:14,868 INFO [RS:2;jenkins-hbase4:34749] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34749%2C1690063572232, suffix=, logDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/WALs/jenkins-hbase4.apache.org,34749,1690063572232, archiveDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/oldWALs, maxLogs=32 2023-07-22 22:06:14,874 DEBUG [jenkins-hbase4:33185] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-22 22:06:14,880 INFO [RS:1;jenkins-hbase4:36573] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36573%2C1690063572179, suffix=, logDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/WALs/jenkins-hbase4.apache.org,36573,1690063572179, archiveDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/oldWALs, maxLogs=32 2023-07-22 22:06:14,886 INFO [RS:0;jenkins-hbase4:38207] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38207%2C1690063572104, suffix=, logDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/WALs/jenkins-hbase4.apache.org,38207,1690063572104, archiveDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/oldWALs, maxLogs=32 2023-07-22 22:06:14,886 DEBUG [jenkins-hbase4:33185] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:06:14,895 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34585,DS-d7ab88a7-c11b-49c0-8bfe-a2bd41df9157,DISK] 2023-07-22 22:06:14,903 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46391,DS-31a51825-9ad1-402f-b04c-ee5b9c698996,DISK] 2023-07-22 22:06:14,903 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44523,DS-6087049d-88f2-4c88-850b-2978852aaf15,DISK] 2023-07-22 22:06:14,905 DEBUG [jenkins-hbase4:33185] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:06:14,905 DEBUG [jenkins-hbase4:33185] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:06:14,905 DEBUG [jenkins-hbase4:33185] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:06:14,905 DEBUG [jenkins-hbase4:33185] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:06:14,919 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34749,1690063572232, state=OPENING 2023-07-22 22:06:14,920 INFO [RS:2;jenkins-hbase4:34749] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/WALs/jenkins-hbase4.apache.org,34749,1690063572232/jenkins-hbase4.apache.org%2C34749%2C1690063572232.1690063574871 2023-07-22 22:06:14,929 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-22 22:06:14,930 DEBUG [RS:2;jenkins-hbase4:34749] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34585,DS-d7ab88a7-c11b-49c0-8bfe-a2bd41df9157,DISK], DatanodeInfoWithStorage[127.0.0.1:46391,DS-31a51825-9ad1-402f-b04c-ee5b9c698996,DISK], DatanodeInfoWithStorage[127.0.0.1:44523,DS-6087049d-88f2-4c88-850b-2978852aaf15,DISK]] 2023-07-22 22:06:14,939 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:14,942 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-22 22:06:14,952 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:06:14,972 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46391,DS-31a51825-9ad1-402f-b04c-ee5b9c698996,DISK] 2023-07-22 22:06:14,973 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44523,DS-6087049d-88f2-4c88-850b-2978852aaf15,DISK] 2023-07-22 22:06:14,973 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34585,DS-d7ab88a7-c11b-49c0-8bfe-a2bd41df9157,DISK] 2023-07-22 22:06:14,980 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44523,DS-6087049d-88f2-4c88-850b-2978852aaf15,DISK] 2023-07-22 22:06:14,990 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34585,DS-d7ab88a7-c11b-49c0-8bfe-a2bd41df9157,DISK] 2023-07-22 22:06:14,991 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46391,DS-31a51825-9ad1-402f-b04c-ee5b9c698996,DISK] 2023-07-22 22:06:14,992 INFO [RS:1;jenkins-hbase4:36573] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/WALs/jenkins-hbase4.apache.org,36573,1690063572179/jenkins-hbase4.apache.org%2C36573%2C1690063572179.1690063574882 2023-07-22 22:06:15,007 DEBUG [RS:1;jenkins-hbase4:36573] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46391,DS-31a51825-9ad1-402f-b04c-ee5b9c698996,DISK], DatanodeInfoWithStorage[127.0.0.1:34585,DS-d7ab88a7-c11b-49c0-8bfe-a2bd41df9157,DISK], DatanodeInfoWithStorage[127.0.0.1:44523,DS-6087049d-88f2-4c88-850b-2978852aaf15,DISK]] 2023-07-22 22:06:15,013 INFO [RS:0;jenkins-hbase4:38207] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/WALs/jenkins-hbase4.apache.org,38207,1690063572104/jenkins-hbase4.apache.org%2C38207%2C1690063572104.1690063574887 2023-07-22 22:06:15,016 DEBUG [RS:0;jenkins-hbase4:38207] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44523,DS-6087049d-88f2-4c88-850b-2978852aaf15,DISK], DatanodeInfoWithStorage[127.0.0.1:34585,DS-d7ab88a7-c11b-49c0-8bfe-a2bd41df9157,DISK], DatanodeInfoWithStorage[127.0.0.1:46391,DS-31a51825-9ad1-402f-b04c-ee5b9c698996,DISK]] 2023-07-22 22:06:15,172 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:15,178 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 22:06:15,181 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46540, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 22:06:15,198 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-22 22:06:15,199 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 22:06:15,204 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34749%2C1690063572232.meta, suffix=.meta, logDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/WALs/jenkins-hbase4.apache.org,34749,1690063572232, archiveDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/oldWALs, maxLogs=32 2023-07-22 22:06:15,233 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34585,DS-d7ab88a7-c11b-49c0-8bfe-a2bd41df9157,DISK] 2023-07-22 22:06:15,243 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46391,DS-31a51825-9ad1-402f-b04c-ee5b9c698996,DISK] 2023-07-22 22:06:15,249 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44523,DS-6087049d-88f2-4c88-850b-2978852aaf15,DISK] 2023-07-22 22:06:15,255 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/WALs/jenkins-hbase4.apache.org,34749,1690063572232/jenkins-hbase4.apache.org%2C34749%2C1690063572232.meta.1690063575206.meta 2023-07-22 22:06:15,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34585,DS-d7ab88a7-c11b-49c0-8bfe-a2bd41df9157,DISK], DatanodeInfoWithStorage[127.0.0.1:46391,DS-31a51825-9ad1-402f-b04c-ee5b9c698996,DISK], DatanodeInfoWithStorage[127.0.0.1:44523,DS-6087049d-88f2-4c88-850b-2978852aaf15,DISK]] 2023-07-22 22:06:15,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-22 22:06:15,264 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-22 22:06:15,265 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:15,266 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-22 22:06:15,268 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-22 22:06:15,270 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-22 22:06:15,284 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-22 22:06:15,284 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:15,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-22 22:06:15,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-22 22:06:15,290 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-22 22:06:15,293 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/info 2023-07-22 22:06:15,294 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/info 2023-07-22 22:06:15,295 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-22 22:06:15,297 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:15,298 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-22 22:06:15,300 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/rep_barrier 2023-07-22 22:06:15,300 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/rep_barrier 2023-07-22 22:06:15,301 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-22 22:06:15,302 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:15,302 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-22 22:06:15,303 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/table 2023-07-22 22:06:15,304 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/table 2023-07-22 22:06:15,304 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-22 22:06:15,305 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:15,307 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740 2023-07-22 22:06:15,310 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740 2023-07-22 22:06:15,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-22 22:06:15,316 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-22 22:06:15,318 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63181837, jitterRate=-0.05851726233959198}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-22 22:06:15,322 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-22 22:06:15,333 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690063575164 2023-07-22 22:06:15,356 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-22 22:06:15,357 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-22 22:06:15,357 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34749,1690063572232, state=OPEN 2023-07-22 22:06:15,360 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-22 22:06:15,361 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-22 22:06:15,366 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-22 22:06:15,367 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34749,1690063572232 in 409 msec 2023-07-22 22:06:15,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-22 22:06:15,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 687 msec 2023-07-22 22:06:15,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1650 sec 2023-07-22 22:06:15,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690063575383, completionTime=-1 2023-07-22 22:06:15,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-22 22:06:15,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-22 22:06:15,472 DEBUG [hconnection-0x55b0e353-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:15,476 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:15,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-22 22:06:15,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690063635506 2023-07-22 22:06:15,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690063695506 2023-07-22 22:06:15,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 123 msec 2023-07-22 22:06:15,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33185,1690063570571-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:15,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33185,1690063570571-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:15,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33185,1690063570571-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:15,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33185, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:15,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-22 22:06:15,548 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-22 22:06:15,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-22 22:06:15,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 22:06:15,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-22 22:06:15,579 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:06:15,582 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:06:15,603 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/hbase/namespace/c8b5ff07971d42c84313908b84ff2b6a 2023-07-22 22:06:15,606 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/hbase/namespace/c8b5ff07971d42c84313908b84ff2b6a empty. 2023-07-22 22:06:15,607 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/hbase/namespace/c8b5ff07971d42c84313908b84ff2b6a 2023-07-22 22:06:15,607 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-22 22:06:15,688 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-22 22:06:15,691 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c8b5ff07971d42c84313908b84ff2b6a, NAME => 'hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:06:15,707 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:15,707 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c8b5ff07971d42c84313908b84ff2b6a, disabling compactions & flushes 2023-07-22 22:06:15,707 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a. 2023-07-22 22:06:15,707 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a. 2023-07-22 22:06:15,707 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a. after waiting 0 ms 2023-07-22 22:06:15,707 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a. 2023-07-22 22:06:15,707 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a. 2023-07-22 22:06:15,707 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c8b5ff07971d42c84313908b84ff2b6a: 2023-07-22 22:06:15,712 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:06:15,727 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690063575715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063575715"}]},"ts":"1690063575715"} 2023-07-22 22:06:15,769 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 22:06:15,772 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:06:15,777 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063575772"}]},"ts":"1690063575772"} 2023-07-22 22:06:15,782 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-22 22:06:15,786 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:06:15,788 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:06:15,788 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:06:15,788 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:06:15,788 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:06:15,791 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c8b5ff07971d42c84313908b84ff2b6a, ASSIGN}] 2023-07-22 22:06:15,794 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c8b5ff07971d42c84313908b84ff2b6a, ASSIGN 2023-07-22 22:06:15,796 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c8b5ff07971d42c84313908b84ff2b6a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34749,1690063572232; forceNewPlan=false, retain=false 2023-07-22 22:06:15,949 INFO [jenkins-hbase4:33185] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 22:06:15,949 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c8b5ff07971d42c84313908b84ff2b6a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:15,950 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690063575949"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063575949"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063575949"}]},"ts":"1690063575949"} 2023-07-22 22:06:15,954 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c8b5ff07971d42c84313908b84ff2b6a, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:06:16,116 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a. 2023-07-22 22:06:16,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c8b5ff07971d42c84313908b84ff2b6a, NAME => 'hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a.', STARTKEY => '', ENDKEY => ''} 2023-07-22 22:06:16,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a. service=AccessControlService 2023-07-22 22:06:16,118 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:16,119 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c8b5ff07971d42c84313908b84ff2b6a 2023-07-22 22:06:16,119 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:16,120 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c8b5ff07971d42c84313908b84ff2b6a 2023-07-22 22:06:16,120 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c8b5ff07971d42c84313908b84ff2b6a 2023-07-22 22:06:16,123 INFO [StoreOpener-c8b5ff07971d42c84313908b84ff2b6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c8b5ff07971d42c84313908b84ff2b6a 2023-07-22 22:06:16,126 DEBUG [StoreOpener-c8b5ff07971d42c84313908b84ff2b6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/namespace/c8b5ff07971d42c84313908b84ff2b6a/info 2023-07-22 22:06:16,126 DEBUG [StoreOpener-c8b5ff07971d42c84313908b84ff2b6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/namespace/c8b5ff07971d42c84313908b84ff2b6a/info 2023-07-22 22:06:16,127 INFO [StoreOpener-c8b5ff07971d42c84313908b84ff2b6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8b5ff07971d42c84313908b84ff2b6a columnFamilyName info 2023-07-22 22:06:16,131 INFO [StoreOpener-c8b5ff07971d42c84313908b84ff2b6a-1] regionserver.HStore(310): Store=c8b5ff07971d42c84313908b84ff2b6a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:16,141 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/namespace/c8b5ff07971d42c84313908b84ff2b6a 2023-07-22 22:06:16,142 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/namespace/c8b5ff07971d42c84313908b84ff2b6a 2023-07-22 22:06:16,148 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c8b5ff07971d42c84313908b84ff2b6a 2023-07-22 22:06:16,165 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/namespace/c8b5ff07971d42c84313908b84ff2b6a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:16,166 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c8b5ff07971d42c84313908b84ff2b6a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65490112, jitterRate=-0.02412128448486328}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:16,166 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c8b5ff07971d42c84313908b84ff2b6a: 2023-07-22 22:06:16,168 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a., pid=6, masterSystemTime=1690063576108 2023-07-22 22:06:16,172 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a. 2023-07-22 22:06:16,172 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a. 2023-07-22 22:06:16,174 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c8b5ff07971d42c84313908b84ff2b6a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:16,174 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690063576173"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063576173"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063576173"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063576173"}]},"ts":"1690063576173"} 2023-07-22 22:06:16,184 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-22 22:06:16,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c8b5ff07971d42c84313908b84ff2b6a, server=jenkins-hbase4.apache.org,34749,1690063572232 in 223 msec 2023-07-22 22:06:16,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-22 22:06:16,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c8b5ff07971d42c84313908b84ff2b6a, ASSIGN in 393 msec 2023-07-22 22:06:16,193 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:06:16,194 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063576193"}]},"ts":"1690063576193"} 2023-07-22 22:06:16,196 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-22 22:06:16,205 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:06:16,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 640 msec 2023-07-22 22:06:16,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-22 22:06:16,283 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-22 22:06:16,283 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:16,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-22 22:06:16,353 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-22 22:06:16,360 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 43 msec 2023-07-22 22:06:16,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-22 22:06:16,390 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-22 22:06:16,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 23 msec 2023-07-22 22:06:16,411 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-22 22:06:16,414 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-22 22:06:16,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.078sec 2023-07-22 22:06:16,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-22 22:06:16,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-22 22:06:16,420 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-22 22:06:16,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33185,1690063570571-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-22 22:06:16,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33185,1690063570571-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-22 22:06:16,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 22:06:16,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-22 22:06:16,454 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:06:16,459 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:06:16,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-22 22:06:16,470 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/hbase/acl/034a80e600f0b0a59826ec1f748ad64f 2023-07-22 22:06:16,471 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/hbase/acl/034a80e600f0b0a59826ec1f748ad64f empty. 2023-07-22 22:06:16,476 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/hbase/acl/034a80e600f0b0a59826ec1f748ad64f 2023-07-22 22:06:16,476 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-22 22:06:16,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 22:06:16,506 DEBUG [Listener at localhost/34823] zookeeper.ReadOnlyZKClient(139): Connect 0x504158e6 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:16,509 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-22 22:06:16,513 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 034a80e600f0b0a59826ec1f748ad64f, NAME => 'hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:06:16,514 DEBUG [Listener at localhost/34823] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40bb1f00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:16,543 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:16,544 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 034a80e600f0b0a59826ec1f748ad64f, disabling compactions & flushes 2023-07-22 22:06:16,544 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f. 2023-07-22 22:06:16,544 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f. 2023-07-22 22:06:16,544 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f. after waiting 0 ms 2023-07-22 22:06:16,544 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f. 2023-07-22 22:06:16,544 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f. 2023-07-22 22:06:16,545 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 034a80e600f0b0a59826ec1f748ad64f: 2023-07-22 22:06:16,547 DEBUG [hconnection-0x2968fc28-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:16,552 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:06:16,554 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690063576553"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063576553"}]},"ts":"1690063576553"} 2023-07-22 22:06:16,566 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 22:06:16,566 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:16,568 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:06:16,568 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063576568"}]},"ts":"1690063576568"} 2023-07-22 22:06:16,569 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33185,1690063570571 2023-07-22 22:06:16,569 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-22 22:06:16,570 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/test.cache.data in system properties and HBase conf 2023-07-22 22:06:16,570 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/hadoop.tmp.dir in system properties and HBase conf 2023-07-22 22:06:16,570 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/hadoop.log.dir in system properties and HBase conf 2023-07-22 22:06:16,570 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-22 22:06:16,570 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-22 22:06:16,570 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-22 22:06:16,571 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-22 22:06:16,571 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-22 22:06:16,571 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-22 22:06:16,571 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-22 22:06:16,571 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 22:06:16,571 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-22 22:06:16,571 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-22 22:06:16,571 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 22:06:16,572 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 22:06:16,572 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-22 22:06:16,572 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/nfs.dump.dir in system properties and HBase conf 2023-07-22 22:06:16,572 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/java.io.tmpdir in system properties and HBase conf 2023-07-22 22:06:16,572 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 22:06:16,572 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-22 22:06:16,572 INFO [Listener at localhost/34823] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-22 22:06:16,575 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:06:16,576 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:06:16,576 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:06:16,576 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:06:16,576 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:06:16,577 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=034a80e600f0b0a59826ec1f748ad64f, ASSIGN}] 2023-07-22 22:06:16,579 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=034a80e600f0b0a59826ec1f748ad64f, ASSIGN 2023-07-22 22:06:16,581 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=034a80e600f0b0a59826ec1f748ad64f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36573,1690063572179; forceNewPlan=false, retain=false 2023-07-22 22:06:16,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 22:06:16,731 INFO [jenkins-hbase4:33185] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 22:06:16,732 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=034a80e600f0b0a59826ec1f748ad64f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:16,732 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690063576732"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063576732"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063576732"}]},"ts":"1690063576732"} 2023-07-22 22:06:16,736 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 034a80e600f0b0a59826ec1f748ad64f, server=jenkins-hbase4.apache.org,36573,1690063572179}] 2023-07-22 22:06:16,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 22:06:16,892 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:16,892 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 22:06:16,896 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 22:06:16,902 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f. 2023-07-22 22:06:16,902 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 034a80e600f0b0a59826ec1f748ad64f, NAME => 'hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f.', STARTKEY => '', ENDKEY => ''} 2023-07-22 22:06:16,903 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f. service=AccessControlService 2023-07-22 22:06:16,903 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:16,903 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 034a80e600f0b0a59826ec1f748ad64f 2023-07-22 22:06:16,903 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:16,903 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 034a80e600f0b0a59826ec1f748ad64f 2023-07-22 22:06:16,903 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 034a80e600f0b0a59826ec1f748ad64f 2023-07-22 22:06:16,907 INFO [StoreOpener-034a80e600f0b0a59826ec1f748ad64f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 034a80e600f0b0a59826ec1f748ad64f 2023-07-22 22:06:16,914 DEBUG [StoreOpener-034a80e600f0b0a59826ec1f748ad64f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/acl/034a80e600f0b0a59826ec1f748ad64f/l 2023-07-22 22:06:16,915 DEBUG [StoreOpener-034a80e600f0b0a59826ec1f748ad64f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/acl/034a80e600f0b0a59826ec1f748ad64f/l 2023-07-22 22:06:16,915 INFO [StoreOpener-034a80e600f0b0a59826ec1f748ad64f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 034a80e600f0b0a59826ec1f748ad64f columnFamilyName l 2023-07-22 22:06:16,916 INFO [StoreOpener-034a80e600f0b0a59826ec1f748ad64f-1] regionserver.HStore(310): Store=034a80e600f0b0a59826ec1f748ad64f/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:16,918 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/acl/034a80e600f0b0a59826ec1f748ad64f 2023-07-22 22:06:16,920 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/acl/034a80e600f0b0a59826ec1f748ad64f 2023-07-22 22:06:16,925 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 034a80e600f0b0a59826ec1f748ad64f 2023-07-22 22:06:16,947 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/acl/034a80e600f0b0a59826ec1f748ad64f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:16,948 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 034a80e600f0b0a59826ec1f748ad64f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59732595, jitterRate=-0.10991497337818146}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:16,949 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 034a80e600f0b0a59826ec1f748ad64f: 2023-07-22 22:06:16,951 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f., pid=11, masterSystemTime=1690063576892 2023-07-22 22:06:16,956 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f. 2023-07-22 22:06:16,957 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f. 2023-07-22 22:06:16,958 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=034a80e600f0b0a59826ec1f748ad64f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:16,958 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690063576958"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063576958"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063576958"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063576958"}]},"ts":"1690063576958"} 2023-07-22 22:06:16,966 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-22 22:06:16,966 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 034a80e600f0b0a59826ec1f748ad64f, server=jenkins-hbase4.apache.org,36573,1690063572179 in 227 msec 2023-07-22 22:06:16,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-22 22:06:16,973 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=034a80e600f0b0a59826ec1f748ad64f, ASSIGN in 390 msec 2023-07-22 22:06:16,974 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:06:16,974 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063576974"}]},"ts":"1690063576974"} 2023-07-22 22:06:16,977 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-22 22:06:16,981 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:06:16,983 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 533 msec 2023-07-22 22:06:17,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 22:06:17,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-22 22:06:17,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-22 22:06:17,860 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:18,180 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:18,189 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43929_jobhistory____.db6tyu/webapp 2023-07-22 22:06:18,363 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-22 22:06:18,363 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-22 22:06:18,363 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 22:06:18,366 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 22:06:18,435 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:18,712 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:19,129 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-22 22:06:19,178 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43929 2023-07-22 22:06:19,354 WARN [Listener at jenkins-hbase4.apache.org/42163] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:19,800 WARN [Listener at jenkins-hbase4.apache.org/42163] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 22:06:19,801 INFO [Listener at jenkins-hbase4.apache.org/42163] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:19,834 INFO [Listener at jenkins-hbase4.apache.org/42163] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44783_cluster____.odat8u/webapp 2023-07-22 22:06:19,941 INFO [Listener at jenkins-hbase4.apache.org/42163] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 22:06:19,941 INFO [Listener at jenkins-hbase4.apache.org/42163] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-22 22:06:19,941 INFO [Listener at jenkins-hbase4.apache.org/42163] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 22:06:19,942 INFO [Listener at jenkins-hbase4.apache.org/42163] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 22:06:19,953 INFO [Listener at jenkins-hbase4.apache.org/42163] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:20,172 INFO [Listener at jenkins-hbase4.apache.org/42163] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:20,271 INFO [Listener at jenkins-hbase4.apache.org/42163] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:20,285 INFO [Listener at jenkins-hbase4.apache.org/42163] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44783 2023-07-22 22:06:20,812 WARN [Listener at jenkins-hbase4.apache.org/43111] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:20,842 WARN [Listener at jenkins-hbase4.apache.org/43111] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 22:06:20,843 INFO [Listener at jenkins-hbase4.apache.org/43111] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:20,850 INFO [Listener at jenkins-hbase4.apache.org/43111] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33575_node____lfbkxd/webapp 2023-07-22 22:06:20,898 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:06:20,930 INFO [Listener at jenkins-hbase4.apache.org/43111] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-22 22:06:20,931 INFO [Listener at jenkins-hbase4.apache.org/43111] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 22:06:20,931 INFO [Listener at jenkins-hbase4.apache.org/43111] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 22:06:20,931 INFO [Listener at jenkins-hbase4.apache.org/43111] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 22:06:20,959 INFO [Listener at jenkins-hbase4.apache.org/43111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:20,989 INFO [Listener at jenkins-hbase4.apache.org/43111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:21,103 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-22 22:06:21,104 INFO [Listener at jenkins-hbase4.apache.org/43111] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:21,106 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-22 22:06:21,107 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-22 22:06:21,108 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:06:21,109 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-22 22:06:21,109 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:06:21,109 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-22 22:06:21,110 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-22 22:06:21,110 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-22 22:06:21,110 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:06:21,110 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-22 22:06:21,110 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-22 22:06:21,110 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-22 22:06:21,131 INFO [Listener at jenkins-hbase4.apache.org/43111] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33575 2023-07-22 22:06:21,414 WARN [Listener at jenkins-hbase4.apache.org/35991] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 22:06:21,424 WARN [Listener at jenkins-hbase4.apache.org/35991] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 22:06:21,425 INFO [Listener at jenkins-hbase4.apache.org/35991] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 22:06:21,434 INFO [Listener at jenkins-hbase4.apache.org/35991] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34317_node____.sbg7xm/webapp 2023-07-22 22:06:21,504 INFO [Listener at jenkins-hbase4.apache.org/35991] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-22 22:06:21,504 INFO [Listener at jenkins-hbase4.apache.org/35991] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 22:06:21,504 INFO [Listener at jenkins-hbase4.apache.org/35991] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 22:06:21,505 INFO [Listener at jenkins-hbase4.apache.org/35991] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 22:06:21,513 INFO [Listener at jenkins-hbase4.apache.org/35991] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:21,528 INFO [Listener at jenkins-hbase4.apache.org/35991] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:21,598 INFO [Listener at jenkins-hbase4.apache.org/35991] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 22:06:21,603 INFO [Listener at jenkins-hbase4.apache.org/35991] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34317 2023-07-22 22:06:21,628 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-22 22:06:21,630 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:21,717 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=272, ProcessCount=173, AvailableMemoryMB=8371 2023-07-22 22:06:21,717 WARN [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-22 22:06:21,734 DEBUG [Listener at jenkins-hbase4.apache.org/35991] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 22:06:21,743 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-22 22:06:21,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 22:06:21,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:21,756 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:06:21,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-22 22:06:21,759 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:06:21,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 22:06:21,764 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78 2023-07-22 22:06:21,764 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb 2023-07-22 22:06:21,765 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78 empty. 2023-07-22 22:06:21,765 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb empty. 2023-07-22 22:06:21,766 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78 2023-07-22 22:06:21,767 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb 2023-07-22 22:06:21,767 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-22 22:06:21,796 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-22 22:06:21,798 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9593437edacfb288a367bfa605670b78, NAME => 'testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:06:21,798 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => c92715930b6120c3958ca87ab53d8abb, NAME => 'testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:06:21,834 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:21,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing c92715930b6120c3958ca87ab53d8abb, disabling compactions & flushes 2023-07-22 22:06:21,837 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. 2023-07-22 22:06:21,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. 2023-07-22 22:06:21,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. after waiting 0 ms 2023-07-22 22:06:21,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. 2023-07-22 22:06:21,837 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. 2023-07-22 22:06:21,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for c92715930b6120c3958ca87ab53d8abb: 2023-07-22 22:06:21,838 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:21,838 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 9593437edacfb288a367bfa605670b78, disabling compactions & flushes 2023-07-22 22:06:21,838 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:21,838 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:21,838 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. after waiting 0 ms 2023-07-22 22:06:21,838 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:21,839 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:21,839 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 9593437edacfb288a367bfa605670b78: 2023-07-22 22:06:21,843 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:06:21,844 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063581844"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063581844"}]},"ts":"1690063581844"} 2023-07-22 22:06:21,844 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063581844"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063581844"}]},"ts":"1690063581844"} 2023-07-22 22:06:21,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 22:06:21,892 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 22:06:21,893 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:06:21,893 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063581893"}]},"ts":"1690063581893"} 2023-07-22 22:06:21,897 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-22 22:06:21,902 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:06:21,904 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:06:21,905 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:06:21,905 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:06:21,905 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:06:21,905 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9593437edacfb288a367bfa605670b78, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c92715930b6120c3958ca87ab53d8abb, ASSIGN}] 2023-07-22 22:06:21,908 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c92715930b6120c3958ca87ab53d8abb, ASSIGN 2023-07-22 22:06:21,908 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9593437edacfb288a367bfa605670b78, ASSIGN 2023-07-22 22:06:21,909 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c92715930b6120c3958ca87ab53d8abb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34749,1690063572232; forceNewPlan=false, retain=false 2023-07-22 22:06:21,909 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9593437edacfb288a367bfa605670b78, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36573,1690063572179; forceNewPlan=false, retain=false 2023-07-22 22:06:22,059 INFO [jenkins-hbase4:33185] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 22:06:22,062 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9593437edacfb288a367bfa605670b78, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:22,062 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c92715930b6120c3958ca87ab53d8abb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:22,062 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063582062"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063582062"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063582062"}]},"ts":"1690063582062"} 2023-07-22 22:06:22,062 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063582062"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063582062"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063582062"}]},"ts":"1690063582062"} 2023-07-22 22:06:22,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 22:06:22,065 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 9593437edacfb288a367bfa605670b78, server=jenkins-hbase4.apache.org,36573,1690063572179}] 2023-07-22 22:06:22,066 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure c92715930b6120c3958ca87ab53d8abb, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:06:22,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. 2023-07-22 22:06:22,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c92715930b6120c3958ca87ab53d8abb, NAME => 'testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 22:06:22,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. service=AccessControlService 2023-07-22 22:06:22,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:22,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName c92715930b6120c3958ca87ab53d8abb 2023-07-22 22:06:22,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:22,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c92715930b6120c3958ca87ab53d8abb 2023-07-22 22:06:22,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c92715930b6120c3958ca87ab53d8abb 2023-07-22 22:06:22,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:22,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9593437edacfb288a367bfa605670b78, NAME => 'testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 22:06:22,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. service=AccessControlService 2023-07-22 22:06:22,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:22,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 9593437edacfb288a367bfa605670b78 2023-07-22 22:06:22,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:22,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9593437edacfb288a367bfa605670b78 2023-07-22 22:06:22,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9593437edacfb288a367bfa605670b78 2023-07-22 22:06:22,238 INFO [StoreOpener-c92715930b6120c3958ca87ab53d8abb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c92715930b6120c3958ca87ab53d8abb 2023-07-22 22:06:22,239 INFO [StoreOpener-9593437edacfb288a367bfa605670b78-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9593437edacfb288a367bfa605670b78 2023-07-22 22:06:22,241 DEBUG [StoreOpener-c92715930b6120c3958ca87ab53d8abb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/cf 2023-07-22 22:06:22,241 DEBUG [StoreOpener-c92715930b6120c3958ca87ab53d8abb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/cf 2023-07-22 22:06:22,241 DEBUG [StoreOpener-9593437edacfb288a367bfa605670b78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/cf 2023-07-22 22:06:22,241 INFO [StoreOpener-c92715930b6120c3958ca87ab53d8abb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c92715930b6120c3958ca87ab53d8abb columnFamilyName cf 2023-07-22 22:06:22,241 DEBUG [StoreOpener-9593437edacfb288a367bfa605670b78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/cf 2023-07-22 22:06:22,242 INFO [StoreOpener-9593437edacfb288a367bfa605670b78-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9593437edacfb288a367bfa605670b78 columnFamilyName cf 2023-07-22 22:06:22,242 INFO [StoreOpener-c92715930b6120c3958ca87ab53d8abb-1] regionserver.HStore(310): Store=c92715930b6120c3958ca87ab53d8abb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:22,245 INFO [StoreOpener-9593437edacfb288a367bfa605670b78-1] regionserver.HStore(310): Store=9593437edacfb288a367bfa605670b78/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:22,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb 2023-07-22 22:06:22,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78 2023-07-22 22:06:22,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb 2023-07-22 22:06:22,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78 2023-07-22 22:06:22,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c92715930b6120c3958ca87ab53d8abb 2023-07-22 22:06:22,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9593437edacfb288a367bfa605670b78 2023-07-22 22:06:22,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:22,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c92715930b6120c3958ca87ab53d8abb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62767748, jitterRate=-0.06468766927719116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:22,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c92715930b6120c3958ca87ab53d8abb: 2023-07-22 22:06:22,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:22,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9593437edacfb288a367bfa605670b78; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62674497, jitterRate=-0.06607721745967865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:22,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb., pid=16, masterSystemTime=1690063582219 2023-07-22 22:06:22,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9593437edacfb288a367bfa605670b78: 2023-07-22 22:06:22,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78., pid=15, masterSystemTime=1690063582218 2023-07-22 22:06:22,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. 2023-07-22 22:06:22,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. 2023-07-22 22:06:22,270 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c92715930b6120c3958ca87ab53d8abb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:22,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:22,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:22,271 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063582270"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063582270"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063582270"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063582270"}]},"ts":"1690063582270"} 2023-07-22 22:06:22,271 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9593437edacfb288a367bfa605670b78, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:22,272 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063582271"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063582271"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063582271"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063582271"}]},"ts":"1690063582271"} 2023-07-22 22:06:22,286 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-22 22:06:22,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure c92715930b6120c3958ca87ab53d8abb, server=jenkins-hbase4.apache.org,34749,1690063572232 in 207 msec 2023-07-22 22:06:22,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-22 22:06:22,289 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 9593437edacfb288a367bfa605670b78, server=jenkins-hbase4.apache.org,36573,1690063572179 in 215 msec 2023-07-22 22:06:22,291 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c92715930b6120c3958ca87ab53d8abb, ASSIGN in 382 msec 2023-07-22 22:06:22,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-22 22:06:22,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9593437edacfb288a367bfa605670b78, ASSIGN in 384 msec 2023-07-22 22:06:22,295 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:06:22,295 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063582295"}]},"ts":"1690063582295"} 2023-07-22 22:06:22,297 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-22 22:06:22,300 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:06:22,305 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-22 22:06:22,312 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:22,315 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:22,319 DEBUG [hconnection-0x45830608-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:22,320 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-22 22:06:22,329 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36573] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 22:06:22,365 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:22,365 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:22,365 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:06:22,365 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:22,365 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:22,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 22:06:22,372 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 22:06:22,372 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 22:06:22,372 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:22,372 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:22,373 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:22,373 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:22,375 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 620 msec 2023-07-22 22:06:22,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 22:06:22,867 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-22 22:06:22,868 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-22 22:06:22,869 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:22,874 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-22 22:06:22,875 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:22,875 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-22 22:06:22,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 22:06:22,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063582890 (current time:1690063582890). 2023-07-22 22:06:22,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:06:22,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x1c7dde05 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:22,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2348fb41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:22,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:22,906 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:22,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c7dde05 to 127.0.0.1:64066 2023-07-22 22:06:22,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:22,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x7671ef15 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:22,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76902c40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:22,921 DEBUG [hconnection-0x21dd2582-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:22,924 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:22,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:22,931 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:22,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7671ef15 to 127.0.0.1:64066 2023-07-22 22:06:22,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:22,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 22:06:22,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:06:22,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 22:06:22,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 22:06:22,996 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 22:06:23,003 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690064183003 2023-07-22 22:06:23,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 22:06:23,004 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-22 22:06:23,014 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 22:06:23,017 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:06:23,017 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:06:23,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 22:06:23,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 33 msec 2023-07-22 22:06:23,022 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 22:06:23,024 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690064183024 2023-07-22 22:06:23,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,079 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-22 22:06:23,079 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:23,081 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-22 22:06:23,081 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-22 22:06:23,082 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,082 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,086 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:23,086 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:23,086 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,086 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:23,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:23,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:23,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:23,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:23,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:23,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:23,087 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,087 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,088 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 22:06:23,088 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:06:23,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,089 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 22:06:23,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 22:06:23,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 22:06:23,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,091 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 22:06:23,091 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 22:06:23,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,094 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 22:06:23,094 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:23,094 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 22:06:23,096 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:23,097 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 22:06:23,097 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 22:06:23,097 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 22:06:23,097 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 22:06:23,097 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:23,097 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 22:06:23,097 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 22:06:23,099 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 22:06:23,099 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 22:06:23,099 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 22:06:23,099 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 22:06:23,102 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,103 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,103 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,103 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,103 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:23,104 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,104 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:23,104 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,104 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:23,104 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,104 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:23,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-22 22:06:23,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2772dfa0[Count = 1] remaining members to acquire global barrier 2023-07-22 22:06:23,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,117 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:23,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:23,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 22:06:23,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:23,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-22 22:06:23,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2772dfa0[Count = 0] remaining members to acquire global barrier 2023-07-22 22:06:23,129 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-22 22:06:23,129 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:06:23,129 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,133 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,133 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,133 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,133 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 22:06:23,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,133 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 22:06:23,133 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38207,1690063572104' in zk 2023-07-22 22:06:23,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,134 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 22:06:23,134 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,135 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,135 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:06:23,135 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:23,135 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:23,136 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. 2023-07-22 22:06:23,136 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. started... 2023-07-22 22:06:23,140 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c92715930b6120c3958ca87ab53d8abb: 2023-07-22 22:06:23,141 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 22:06:23,141 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:23,142 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:23,142 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:23,142 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,142 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. started... 2023-07-22 22:06:23,143 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 22:06:23,143 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:23,143 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 22:06:23,145 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9593437edacfb288a367bfa605670b78: 2023-07-22 22:06:23,146 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,150 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:23,150 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:23,155 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:06:23,155 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:06:23,213 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. completed. 2023-07-22 22:06:23,214 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:23,214 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:23,214 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:23,214 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,214 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 22:06:23,214 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36573,1690063572179' in zk 2023-07-22 22:06:23,217 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 22:06:23,217 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,217 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:23,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,218 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 22:06:23,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,221 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. completed. 2023-07-22 22:06:23,221 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. 2023-07-22 22:06:23,221 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:23,221 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:23,221 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,221 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 22:06:23,221 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34749,1690063572232' in zk 2023-07-22 22:06:23,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,223 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,223 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 22:06:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,223 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:23,223 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 22:06:23,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:23,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36573,1690063572179': 2023-07-22 22:06:23,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-22 22:06:23,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:23,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:23,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34749,1690063572232': 2023-07-22 22:06:23,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-22 22:06:23,236 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-22 22:06:23,236 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:06:23,236 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:06:23,236 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,236 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:06:23,240 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,240 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,240 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,240 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,240 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,240 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:23,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,240 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:23,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:23,241 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:23,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:23,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:23,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:23,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:23,241 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,242 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,245 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,245 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:23,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,246 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:23,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,259 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:23,259 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:23,259 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:23,259 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:23,259 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:23,259 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:23,260 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:23,260 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,259 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:23,260 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:23,260 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:23,261 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:23,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:23,261 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,261 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,261 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,261 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:23,261 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:23,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:23,261 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:23,261 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:23,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:23,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:23,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,329 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:23,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 22:06:23,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:23,332 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 22:06:23,361 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-22 22:06:23,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,362 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:23,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690063583004Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690063583260 (+256 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690063583261 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690063583277 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690063583299 (+22 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690063583361 (+62 ms) 2023-07-22 22:06:23,364 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 22:06:23,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 350 msec 2023-07-22 22:06:23,632 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:23,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 22:06:23,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:06:23,660 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:23,666 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:23,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36573] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:06:23,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:06:23,675 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-22 22:06:23,676 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:23,678 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:23,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 22:06:23,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063583711 (current time:1690063583711). 2023-07-22 22:06:23,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:06:23,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x231c3941 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:23,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c0a998d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:23,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:23,748 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:23,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x231c3941 to 127.0.0.1:64066 2023-07-22 22:06:23,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:23,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x043ec960 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:23,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46aa3e97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:23,786 DEBUG [hconnection-0x5ef4113e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:23,787 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:23,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:23,797 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:23,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x043ec960 to 127.0.0.1:64066 2023-07-22 22:06:23,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:23,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 22:06:23,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:06:23,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 22:06:23,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 22:06:23,805 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 22:06:23,807 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690064183807 2023-07-22 22:06:23,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-22 22:06:23,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 22:06:23,809 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:06:23,809 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:06:23,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 22:06:23,811 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 22:06:23,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-22 22:06:23,816 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 22:06:23,821 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690064183821 2023-07-22 22:06:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-22 22:06:23,851 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-22 22:06:23,851 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:23,853 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-22 22:06:23,853 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-22 22:06:23,853 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,853 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,856 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:23,856 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:23,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:23,856 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:23,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:23,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:23,856 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:23,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,857 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,858 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 22:06:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 22:06:23,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 22:06:23,859 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,859 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:06:23,859 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 22:06:23,859 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 22:06:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,859 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 22:06:23,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 22:06:23,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,860 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 22:06:23,861 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 22:06:23,862 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 22:06:23,862 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 22:06:23,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 22:06:23,862 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:23,863 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 22:06:23,863 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:23,862 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 22:06:23,864 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 22:06:23,864 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 22:06:23,864 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 22:06:23,864 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 22:06:23,863 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 22:06:23,864 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 22:06:23,865 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 22:06:23,867 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,867 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,868 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,868 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,868 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,868 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,868 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:23,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,869 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,869 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,869 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:23,869 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:23,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:23,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:23,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-22 22:06:23,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dcff978[Count = 1] remaining members to acquire global barrier 2023-07-22 22:06:23,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:23,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:23,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:23,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:23,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:23,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:23,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:23,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-22 22:06:23,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dcff978[Count = 0] remaining members to acquire global barrier 2023-07-22 22:06:23,877 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-22 22:06:23,878 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,883 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,883 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,883 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,883 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 22:06:23,883 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 22:06:23,883 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 22:06:23,883 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:23,883 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38207,1690063572104' in zk 2023-07-22 22:06:23,883 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:23,884 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. 2023-07-22 22:06:23,884 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:23,884 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. started... 2023-07-22 22:06:23,884 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:23,884 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:06:23,884 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c92715930b6120c3958ca87ab53d8abb 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-22 22:06:23,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:23,887 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 22:06:23,887 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 22:06:23,887 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:23,887 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 22:06:23,888 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:23,890 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:23,890 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:23,890 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. started... 2023-07-22 22:06:23,890 INFO [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9593437edacfb288a367bfa605670b78 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-22 22:06:23,909 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:23,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 22:06:23,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:23,911 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:06:23,999 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.80 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/.tmp/cf/faacd6da8d5b412f8d74594567e97a18 2023-07-22 22:06:24,000 INFO [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=467 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/.tmp/cf/7cdbbdf6947d48ea96707315060a2e88 2023-07-22 22:06:24,059 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/.tmp/cf/faacd6da8d5b412f8d74594567e97a18 as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/cf/faacd6da8d5b412f8d74594567e97a18 2023-07-22 22:06:24,059 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/.tmp/cf/7cdbbdf6947d48ea96707315060a2e88 as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/cf/7cdbbdf6947d48ea96707315060a2e88 2023-07-22 22:06:24,070 INFO [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/cf/7cdbbdf6947d48ea96707315060a2e88, entries=7, sequenceid=6, filesize=5.3 K 2023-07-22 22:06:24,072 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/cf/faacd6da8d5b412f8d74594567e97a18, entries=43, sequenceid=6, filesize=7.7 K 2023-07-22 22:06:24,075 INFO [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 9593437edacfb288a367bfa605670b78 in 184ms, sequenceid=6, compaction requested=false 2023-07-22 22:06:24,075 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-22 22:06:24,076 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9593437edacfb288a367bfa605670b78: 2023-07-22 22:06:24,077 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-22 22:06:24,077 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:24,077 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/cf/7cdbbdf6947d48ea96707315060a2e88] hfiles 2023-07-22 22:06:24,077 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/cf/7cdbbdf6947d48ea96707315060a2e88 for snapshot=snaptb0-testExportWithTargetName 2023-07-22 22:06:24,078 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for c92715930b6120c3958ca87ab53d8abb in 194ms, sequenceid=6, compaction requested=false 2023-07-22 22:06:24,079 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c92715930b6120c3958ca87ab53d8abb: 2023-07-22 22:06:24,079 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-22 22:06:24,079 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:24,080 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/cf/faacd6da8d5b412f8d74594567e97a18] hfiles 2023-07-22 22:06:24,080 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/cf/faacd6da8d5b412f8d74594567e97a18 for snapshot=snaptb0-testExportWithTargetName 2023-07-22 22:06:24,105 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. completed. 2023-07-22 22:06:24,106 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:24,106 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:24,106 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:24,106 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:24,106 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 22:06:24,106 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36573,1690063572179' in zk 2023-07-22 22:06:24,108 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 22:06:24,108 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:24,108 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:24,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:24,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:24,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:24,109 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 22:06:24,111 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. completed. 2023-07-22 22:06:24,111 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. 2023-07-22 22:06:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:24,111 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:24,111 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:24,111 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:24,111 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 22:06:24,111 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34749,1690063572232' in zk 2023-07-22 22:06:24,111 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:24,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:24,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:24,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 22:06:24,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:24,114 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 22:06:24,115 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:24,115 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 22:06:24,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:24,115 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:24,115 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 22:06:24,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:24,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:24,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:24,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:24,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:24,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:24,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36573,1690063572179': 2023-07-22 22:06:24,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-22 22:06:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:24,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:24,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:24,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:24,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:24,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:24,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:24,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:24,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:24,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:24,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:24,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:24,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34749,1690063572232': 2023-07-22 22:06:24,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-22 22:06:24,127 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-22 22:06:24,127 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:06:24,127 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:06:24,127 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-22 22:06:24,127 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:06:24,129 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,129 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,129 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,129 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:24,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,129 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:24,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:24,129 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,130 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:24,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,130 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:24,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:24,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:24,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:24,131 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:24,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:24,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:24,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:24,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,132 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:24,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:24,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:24,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:24,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:24,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:24,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:24,134 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:24,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:24,134 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:24,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 22:06:24,135 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:24,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:24,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:24,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:24,146 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:24,146 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,146 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:24,146 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:24,146 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:24,146 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:24,146 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:24,146 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:24,146 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:24,146 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-22 22:06:24,146 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:24,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-22 22:06:24,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:24,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:24,146 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:24,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:24,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:24,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:24,147 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:24,148 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:24,149 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,149 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:24,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,149 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:24,149 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,149 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:24,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:24,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:24,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:24,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:24,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:24,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,414 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:24,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 22:06:24,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:24,416 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 22:06:24,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-22 22:06:24,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,634 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 22:06:24,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690063583807Consolidate snapshot: snaptb0-testExportWithTargetName at 1690063584147 (+340 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1690063584147Writing data manifest for snaptb0-testExportWithTargetName at 1690063584154 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690063584173 (+19 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690063584633 (+460 ms) 2023-07-22 22:06:24,636 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 22:06:24,638 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 828 msec 2023-07-22 22:06:24,916 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:24,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 22:06:24,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:06:24,919 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063584919 2023-07-22 22:06:24,920 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37905, tgtDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063584919, rawTgtDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063584919, srcFsUri=hdfs://localhost:37905, srcDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:06:24,963 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37905, inputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:06:24,963 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_275034674_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063584919, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063584919/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-22 22:06:24,964 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37905, inputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3, snapshotDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-22 22:06:24,984 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063584919/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-22 22:06:25,055 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:25,056 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:25,056 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:25,056 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:25,057 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:25,057 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:25,058 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:25,137 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/hadoop-2972822618274390366.jar 2023-07-22 22:06:25,138 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:25,139 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:25,140 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:25,140 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:25,141 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:25,142 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:25,143 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 22:06:25,143 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 22:06:25,144 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 22:06:25,145 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 22:06:25,146 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 22:06:25,146 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 22:06:25,147 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 22:06:25,148 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 22:06:25,148 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 22:06:25,149 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 22:06:25,153 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:25,153 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:25,154 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:25,154 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:25,154 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:25,155 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:25,155 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:26,296 WARN [Listener at jenkins-hbase4.apache.org/35991] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 22:06:26,302 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-22 22:06:26,312 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-22 22:06:26,853 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:06:26,855 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:06:27,446 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0001_000001 (auth:SIMPLE) 2023-07-22 22:06:27,736 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:06:32,776 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0001_000001 (auth:SIMPLE) 2023-07-22 22:06:35,019 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0001_000001 (auth:SIMPLE) 2023-07-22 22:06:38,120 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0001_000001 (auth:SIMPLE) 2023-07-22 22:06:39,241 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 22:06:39,245 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 22:06:39,254 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-22 22:06:39,254 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 22:06:39,255 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 22:06:39,255 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2071152985_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-22 22:06:39,256 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-22 22:06:39,256 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-22 22:06:39,256 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2071152985_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063584919/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063584919/.hbase-snapshot/testExportWithTargetName 2023-07-22 22:06:39,256 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063584919/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-22 22:06:39,257 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063584919/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-22 22:06:39,266 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-22 22:06:39,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-22 22:06:39,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:39,283 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063599283"}]},"ts":"1690063599283"} 2023-07-22 22:06:39,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 22:06:39,285 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-22 22:06:39,287 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-22 22:06:39,289 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9593437edacfb288a367bfa605670b78, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c92715930b6120c3958ca87ab53d8abb, UNASSIGN}] 2023-07-22 22:06:39,291 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9593437edacfb288a367bfa605670b78, UNASSIGN 2023-07-22 22:06:39,291 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c92715930b6120c3958ca87ab53d8abb, UNASSIGN 2023-07-22 22:06:39,292 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=9593437edacfb288a367bfa605670b78, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:39,292 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c92715930b6120c3958ca87ab53d8abb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:39,292 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063599292"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063599292"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063599292"}]},"ts":"1690063599292"} 2023-07-22 22:06:39,292 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063599292"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063599292"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063599292"}]},"ts":"1690063599292"} 2023-07-22 22:06:39,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 9593437edacfb288a367bfa605670b78, server=jenkins-hbase4.apache.org,36573,1690063572179}] 2023-07-22 22:06:39,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure c92715930b6120c3958ca87ab53d8abb, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:06:39,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 22:06:39,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c92715930b6120c3958ca87ab53d8abb 2023-07-22 22:06:39,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9593437edacfb288a367bfa605670b78 2023-07-22 22:06:39,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c92715930b6120c3958ca87ab53d8abb, disabling compactions & flushes 2023-07-22 22:06:39,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9593437edacfb288a367bfa605670b78, disabling compactions & flushes 2023-07-22 22:06:39,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. 2023-07-22 22:06:39,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:39,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. 2023-07-22 22:06:39,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:39,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. after waiting 0 ms 2023-07-22 22:06:39,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. after waiting 0 ms 2023-07-22 22:06:39,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:39,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. 2023-07-22 22:06:39,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:06:39,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:06:39,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:06:39,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:06:39,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb. 2023-07-22 22:06:39,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78. 2023-07-22 22:06:39,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c92715930b6120c3958ca87ab53d8abb: 2023-07-22 22:06:39,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9593437edacfb288a367bfa605670b78: 2023-07-22 22:06:39,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9593437edacfb288a367bfa605670b78 2023-07-22 22:06:39,474 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=9593437edacfb288a367bfa605670b78, regionState=CLOSED 2023-07-22 22:06:39,474 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063599474"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063599474"}]},"ts":"1690063599474"} 2023-07-22 22:06:39,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c92715930b6120c3958ca87ab53d8abb 2023-07-22 22:06:39,475 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c92715930b6120c3958ca87ab53d8abb, regionState=CLOSED 2023-07-22 22:06:39,475 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690063599475"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063599475"}]},"ts":"1690063599475"} 2023-07-22 22:06:39,479 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-22 22:06:39,479 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 9593437edacfb288a367bfa605670b78, server=jenkins-hbase4.apache.org,36573,1690063572179 in 182 msec 2023-07-22 22:06:39,480 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-22 22:06:39,480 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure c92715930b6120c3958ca87ab53d8abb, server=jenkins-hbase4.apache.org,34749,1690063572232 in 182 msec 2023-07-22 22:06:39,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9593437edacfb288a367bfa605670b78, UNASSIGN in 190 msec 2023-07-22 22:06:39,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-22 22:06:39,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c92715930b6120c3958ca87ab53d8abb, UNASSIGN in 191 msec 2023-07-22 22:06:39,483 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063599483"}]},"ts":"1690063599483"} 2023-07-22 22:06:39,484 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-22 22:06:39,486 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-22 22:06:39,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 214 msec 2023-07-22 22:06:39,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 22:06:39,586 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-22 22:06:39,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-22 22:06:39,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:39,601 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:39,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-22 22:06:39,603 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:39,606 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36573] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-22 22:06:39,609 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78 2023-07-22 22:06:39,609 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb 2023-07-22 22:06:39,610 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 22:06:39,610 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 22:06:39,610 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 22:06:39,610 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 22:06:39,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-22 22:06:39,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-22 22:06:39,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-22 22:06:39,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-22 22:06:39,612 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 22:06:39,612 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 22:06:39,612 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:39,612 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 22:06:39,612 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:39,613 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 22:06:39,613 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:39,612 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:39,614 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/cf, FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/recovered.edits] 2023-07-22 22:06:39,615 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/cf, FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/recovered.edits] 2023-07-22 22:06:39,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-22 22:06:39,622 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/cf/faacd6da8d5b412f8d74594567e97a18 to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/cf/faacd6da8d5b412f8d74594567e97a18 2023-07-22 22:06:39,622 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/cf/7cdbbdf6947d48ea96707315060a2e88 to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/cf/7cdbbdf6947d48ea96707315060a2e88 2023-07-22 22:06:39,627 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/recovered.edits/9.seqid to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb/recovered.edits/9.seqid 2023-07-22 22:06:39,628 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/recovered.edits/9.seqid to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78/recovered.edits/9.seqid 2023-07-22 22:06:39,628 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/c92715930b6120c3958ca87ab53d8abb 2023-07-22 22:06:39,629 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportWithTargetName/9593437edacfb288a367bfa605670b78 2023-07-22 22:06:39,629 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-22 22:06:39,631 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:39,651 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-22 22:06:39,654 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-22 22:06:39,655 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:39,655 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-22 22:06:39,655 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063599655"}]},"ts":"9223372036854775807"} 2023-07-22 22:06:39,656 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063599655"}]},"ts":"9223372036854775807"} 2023-07-22 22:06:39,658 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 22:06:39,658 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9593437edacfb288a367bfa605670b78, NAME => 'testtb-testExportWithTargetName,,1690063581751.9593437edacfb288a367bfa605670b78.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c92715930b6120c3958ca87ab53d8abb, NAME => 'testtb-testExportWithTargetName,1,1690063581751.c92715930b6120c3958ca87ab53d8abb.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 22:06:39,658 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-22 22:06:39,658 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690063599658"}]},"ts":"9223372036854775807"} 2023-07-22 22:06:39,660 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-22 22:06:39,662 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 22:06:39,664 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 70 msec 2023-07-22 22:06:39,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-22 22:06:39,717 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-22 22:06:39,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-22 22:06:39,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-22 22:06:39,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-22 22:06:39,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-22 22:06:39,771 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=753 (was 708) Potentially hanging thread: Thread-1280 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:41983 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1917209193_1 at /127.0.0.1:37228 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2071152985_17 at /127.0.0.1:45402 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:45417 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2071152985_17 at /127.0.0.1:49304 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2071152985_17 at /127.0.0.1:37246 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=917 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=309 (was 272) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=6672 (was 8371) 2023-07-22 22:06:39,772 WARN [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-22 22:06:39,791 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=309, ProcessCount=179, AvailableMemoryMB=6671 2023-07-22 22:06:39,791 WARN [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-22 22:06:39,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 22:06:39,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:39,797 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:06:39,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-22 22:06:39,798 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:06:39,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 22:06:39,801 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2 2023-07-22 22:06:39,801 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3 2023-07-22 22:06:39,802 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2 empty. 2023-07-22 22:06:39,802 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3 empty. 2023-07-22 22:06:39,803 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2 2023-07-22 22:06:39,803 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3 2023-07-22 22:06:39,803 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-22 22:06:39,818 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-22 22:06:39,819 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => af5ff9c801e41e0dfd8cc4c7e04d37b2, NAME => 'testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:06:39,819 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c49bf6c977a00fb6c482a850dfddbde3, NAME => 'testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:06:39,835 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:39,839 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing af5ff9c801e41e0dfd8cc4c7e04d37b2, disabling compactions & flushes 2023-07-22 22:06:39,839 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:39,839 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:39,839 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. after waiting 0 ms 2023-07-22 22:06:39,840 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:39,840 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:39,840 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for af5ff9c801e41e0dfd8cc4c7e04d37b2: 2023-07-22 22:06:39,842 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:39,843 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c49bf6c977a00fb6c482a850dfddbde3, disabling compactions & flushes 2023-07-22 22:06:39,843 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. 2023-07-22 22:06:39,843 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. 2023-07-22 22:06:39,843 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. after waiting 0 ms 2023-07-22 22:06:39,843 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. 2023-07-22 22:06:39,843 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. 2023-07-22 22:06:39,843 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c49bf6c977a00fb6c482a850dfddbde3: 2023-07-22 22:06:39,846 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:06:39,847 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063599847"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063599847"}]},"ts":"1690063599847"} 2023-07-22 22:06:39,847 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063599847"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063599847"}]},"ts":"1690063599847"} 2023-07-22 22:06:39,850 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 22:06:39,851 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:06:39,851 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063599851"}]},"ts":"1690063599851"} 2023-07-22 22:06:39,853 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-22 22:06:39,857 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:06:39,858 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:06:39,858 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:06:39,858 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:06:39,858 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:06:39,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=af5ff9c801e41e0dfd8cc4c7e04d37b2, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c49bf6c977a00fb6c482a850dfddbde3, ASSIGN}] 2023-07-22 22:06:39,861 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c49bf6c977a00fb6c482a850dfddbde3, ASSIGN 2023-07-22 22:06:39,861 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=af5ff9c801e41e0dfd8cc4c7e04d37b2, ASSIGN 2023-07-22 22:06:39,862 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=af5ff9c801e41e0dfd8cc4c7e04d37b2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38207,1690063572104; forceNewPlan=false, retain=false 2023-07-22 22:06:39,862 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c49bf6c977a00fb6c482a850dfddbde3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34749,1690063572232; forceNewPlan=false, retain=false 2023-07-22 22:06:39,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 22:06:40,012 INFO [jenkins-hbase4:33185] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 22:06:40,015 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=af5ff9c801e41e0dfd8cc4c7e04d37b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,015 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c49bf6c977a00fb6c482a850dfddbde3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,015 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063600015"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063600015"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063600015"}]},"ts":"1690063600015"} 2023-07-22 22:06:40,015 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063600015"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063600015"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063600015"}]},"ts":"1690063600015"} 2023-07-22 22:06:40,017 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure af5ff9c801e41e0dfd8cc4c7e04d37b2, server=jenkins-hbase4.apache.org,38207,1690063572104}] 2023-07-22 22:06:40,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure c49bf6c977a00fb6c482a850dfddbde3, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:06:40,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 22:06:40,171 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,172 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 22:06:40,176 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 22:06:40,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. 2023-07-22 22:06:40,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c49bf6c977a00fb6c482a850dfddbde3, NAME => 'testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 22:06:40,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. service=AccessControlService 2023-07-22 22:06:40,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:40,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState c49bf6c977a00fb6c482a850dfddbde3 2023-07-22 22:06:40,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:40,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c49bf6c977a00fb6c482a850dfddbde3 2023-07-22 22:06:40,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c49bf6c977a00fb6c482a850dfddbde3 2023-07-22 22:06:40,182 INFO [StoreOpener-c49bf6c977a00fb6c482a850dfddbde3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c49bf6c977a00fb6c482a850dfddbde3 2023-07-22 22:06:40,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:40,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => af5ff9c801e41e0dfd8cc4c7e04d37b2, NAME => 'testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 22:06:40,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. service=AccessControlService 2023-07-22 22:06:40,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:40,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState af5ff9c801e41e0dfd8cc4c7e04d37b2 2023-07-22 22:06:40,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:40,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for af5ff9c801e41e0dfd8cc4c7e04d37b2 2023-07-22 22:06:40,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for af5ff9c801e41e0dfd8cc4c7e04d37b2 2023-07-22 22:06:40,184 DEBUG [StoreOpener-c49bf6c977a00fb6c482a850dfddbde3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/cf 2023-07-22 22:06:40,184 DEBUG [StoreOpener-c49bf6c977a00fb6c482a850dfddbde3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/cf 2023-07-22 22:06:40,184 INFO [StoreOpener-c49bf6c977a00fb6c482a850dfddbde3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c49bf6c977a00fb6c482a850dfddbde3 columnFamilyName cf 2023-07-22 22:06:40,185 INFO [StoreOpener-af5ff9c801e41e0dfd8cc4c7e04d37b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region af5ff9c801e41e0dfd8cc4c7e04d37b2 2023-07-22 22:06:40,185 INFO [StoreOpener-c49bf6c977a00fb6c482a850dfddbde3-1] regionserver.HStore(310): Store=c49bf6c977a00fb6c482a850dfddbde3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:40,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3 2023-07-22 22:06:40,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3 2023-07-22 22:06:40,187 DEBUG [StoreOpener-af5ff9c801e41e0dfd8cc4c7e04d37b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/cf 2023-07-22 22:06:40,187 DEBUG [StoreOpener-af5ff9c801e41e0dfd8cc4c7e04d37b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/cf 2023-07-22 22:06:40,188 INFO [StoreOpener-af5ff9c801e41e0dfd8cc4c7e04d37b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af5ff9c801e41e0dfd8cc4c7e04d37b2 columnFamilyName cf 2023-07-22 22:06:40,188 INFO [StoreOpener-af5ff9c801e41e0dfd8cc4c7e04d37b2-1] regionserver.HStore(310): Store=af5ff9c801e41e0dfd8cc4c7e04d37b2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:40,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2 2023-07-22 22:06:40,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2 2023-07-22 22:06:40,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c49bf6c977a00fb6c482a850dfddbde3 2023-07-22 22:06:40,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for af5ff9c801e41e0dfd8cc4c7e04d37b2 2023-07-22 22:06:40,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:40,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c49bf6c977a00fb6c482a850dfddbde3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68836976, jitterRate=0.02575087547302246}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:40,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c49bf6c977a00fb6c482a850dfddbde3: 2023-07-22 22:06:40,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3., pid=31, masterSystemTime=1690063600171 2023-07-22 22:06:40,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:40,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened af5ff9c801e41e0dfd8cc4c7e04d37b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58728077, jitterRate=-0.12488345801830292}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:40,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for af5ff9c801e41e0dfd8cc4c7e04d37b2: 2023-07-22 22:06:40,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. 2023-07-22 22:06:40,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. 2023-07-22 22:06:40,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2., pid=30, masterSystemTime=1690063600171 2023-07-22 22:06:40,206 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c49bf6c977a00fb6c482a850dfddbde3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,206 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063600206"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063600206"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063600206"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063600206"}]},"ts":"1690063600206"} 2023-07-22 22:06:40,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:40,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:40,208 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=af5ff9c801e41e0dfd8cc4c7e04d37b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,209 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063600208"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063600208"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063600208"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063600208"}]},"ts":"1690063600208"} 2023-07-22 22:06:40,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-22 22:06:40,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure c49bf6c977a00fb6c482a850dfddbde3, server=jenkins-hbase4.apache.org,34749,1690063572232 in 191 msec 2023-07-22 22:06:40,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-22 22:06:40,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c49bf6c977a00fb6c482a850dfddbde3, ASSIGN in 354 msec 2023-07-22 22:06:40,215 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure af5ff9c801e41e0dfd8cc4c7e04d37b2, server=jenkins-hbase4.apache.org,38207,1690063572104 in 194 msec 2023-07-22 22:06:40,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-22 22:06:40,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=af5ff9c801e41e0dfd8cc4c7e04d37b2, ASSIGN in 356 msec 2023-07-22 22:06:40,218 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:06:40,218 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063600218"}]},"ts":"1690063600218"} 2023-07-22 22:06:40,220 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-22 22:06:40,223 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:06:40,223 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-22 22:06:40,225 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36573] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 22:06:40,226 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:40,226 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:40,226 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:40,226 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:40,227 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:40,228 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:40,228 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:40,228 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:40,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 434 msec 2023-07-22 22:06:40,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 22:06:40,403 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-22 22:06:40,403 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-22 22:06:40,404 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:40,407 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-22 22:06:40,407 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:40,407 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-22 22:06:40,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:06:40,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063600412 (current time:1690063600412). 2023-07-22 22:06:40,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:06:40,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x7be438b9 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:40,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dbccde6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:40,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:40,453 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:40,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7be438b9 to 127.0.0.1:64066 2023-07-22 22:06:40,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:40,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x20ae3f6c to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:40,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a55fa30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:40,478 DEBUG [hconnection-0x413ddb61-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:40,479 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:40,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:40,487 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:40,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20ae3f6c to 127.0.0.1:64066 2023-07-22 22:06:40,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:40,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 22:06:40,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:06:40,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:06:40,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:06:40,498 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:06:40,499 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690064200499 2023-07-22 22:06:40,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-22 22:06:40,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:06:40,501 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:06:40,501 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:06:40,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 22:06:40,503 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:06:40,505 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-22 22:06:40,506 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 22:06:40,507 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690064200507 2023-07-22 22:06:40,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,530 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-22 22:06:40,530 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:40,531 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-22 22:06:40,531 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-22 22:06:40,596 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,596 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,599 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:40,599 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:40,599 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:40,599 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:40,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:40,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:40,599 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:40,599 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,600 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,600 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:06:40,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 22:06:40,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 22:06:40,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,601 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 22:06:40,601 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 22:06:40,601 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:40,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 22:06:40,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,602 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 22:06:40,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:06:40,607 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:40,607 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 22:06:40,607 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:40,607 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:06:40,614 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 22:06:40,614 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 22:06:40,614 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,615 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 22:06:40,615 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 22:06:40,615 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:40,614 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,616 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 22:06:40,616 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 22:06:40,616 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:40,616 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 22:06:40,617 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 22:06:40,617 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 22:06:40,617 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 22:06:40,617 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 22:06:40,619 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,619 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:40,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:40,625 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,625 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,635 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,635 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,636 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:40,635 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:40,635 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,636 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,636 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:40,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:40,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:40,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:40,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:40,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-22 22:06:40,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c7a2b5d[Count = 1] remaining members to acquire global barrier 2023-07-22 22:06:40,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:40,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:40,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:40,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:40,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:40,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:40,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-22 22:06:40,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c7a2b5d[Count = 0] remaining members to acquire global barrier 2023-07-22 22:06:40,647 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 22:06:40,647 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,648 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,648 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,649 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:06:40,649 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,649 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:40,649 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:40,649 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. 2023-07-22 22:06:40,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,649 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. started... 2023-07-22 22:06:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,649 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:06:40,649 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,650 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:06:40,650 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,651 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:40,651 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:40,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,651 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. started... 2023-07-22 22:06:40,651 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c49bf6c977a00fb6c482a850dfddbde3: 2023-07-22 22:06:40,651 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:40,654 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af5ff9c801e41e0dfd8cc4c7e04d37b2: 2023-07-22 22:06:40,654 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,654 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:40,654 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:06:40,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,654 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,662 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:06:40,663 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:40,663 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 22:06:40,663 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:06:40,663 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36573,1690063572179' in zk 2023-07-22 22:06:40,667 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 22:06:40,667 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:40,667 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 22:06:40,686 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. completed. 2023-07-22 22:06:40,686 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:40,686 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:40,686 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:40,686 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,687 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 22:06:40,687 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38207,1690063572104' in zk 2023-07-22 22:06:40,689 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. completed. 2023-07-22 22:06:40,689 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. 2023-07-22 22:06:40,689 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:40,689 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:40,689 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 22:06:40,689 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,689 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,689 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 22:06:40,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:40,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:40,689 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:40,689 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34749,1690063572232' in zk 2023-07-22 22:06:40,689 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 22:06:40,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:40,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:40,693 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,693 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 22:06:40,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,693 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:40,693 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 22:06:40,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:40,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:40,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:40,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38207,1690063572104': 2023-07-22 22:06:40,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 22:06:40,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:40,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:40,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:40,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:40,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34749,1690063572232': 2023-07-22 22:06:40,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 22:06:40,701 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-22 22:06:40,701 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:06:40,701 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:06:40,701 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,701 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:06:40,703 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,703 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:40,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:40,703 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,703 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,704 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:40,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,703 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:40,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:40,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,704 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:40,704 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:40,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:40,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:40,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:40,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,705 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:40,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:40,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:40,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,705 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:40,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:40,707 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,707 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,708 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:40,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:40,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:40,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:40,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:40,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:40,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:40,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:40,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:40,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:40,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:40,711 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,711 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:40,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:40,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:40,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:40,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:40,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,713 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,713 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,713 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,713 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:40,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:40,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:40,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:40,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:40,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:40,713 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,713 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:40,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:40,714 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:40,714 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,714 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:40,808 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:40,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:06:40,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:40,809 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 22:06:41,110 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:41,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:06:41,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:41,111 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 22:06:41,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,157 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-22 22:06:41,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,157 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:41,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690063600499Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690063600711 (+212 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690063600713 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690063600717 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690063601127 (+410 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690063601157 (+30 ms) 2023-07-22 22:06:41,160 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 22:06:41,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 659 msec 2023-07-22 22:06:41,611 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:41,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:06:41,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:06:41,627 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:41,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:06:41,650 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:41,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38207] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:06:41,657 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-22 22:06:41,657 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:41,659 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:41,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:06:41,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063601678 (current time:1690063601678). 2023-07-22 22:06:41,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:06:41,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x568d1bc3 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:41,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2597b74d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:41,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:41,690 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:41,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x568d1bc3 to 127.0.0.1:64066 2023-07-22 22:06:41,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:41,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x7fc21366 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:41,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@599ab6f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:41,717 DEBUG [hconnection-0x5b4db826-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:41,721 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:41,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:41,729 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:41,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7fc21366 to 127.0.0.1:64066 2023-07-22 22:06:41,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:41,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 22:06:41,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:06:41,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:06:41,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:06:41,735 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:06:41,737 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690064201737 2023-07-22 22:06:41,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:06:41,737 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-22 22:06:41,737 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:06:41,738 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:06:41,745 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:06:41,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 22:06:41,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-22 22:06:41,748 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 22:06:41,749 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690064201749 2023-07-22 22:06:41,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-22 22:06:41,784 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-22 22:06:41,784 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:41,786 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-22 22:06:41,786 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-22 22:06:41,786 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,787 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,788 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:41,788 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:41,788 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:41,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:41,788 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:41,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:41,789 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,789 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,790 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,790 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:06:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 22:06:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 22:06:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 22:06:41,790 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 22:06:41,790 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 22:06:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,790 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 22:06:41,790 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 22:06:41,791 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 22:06:41,791 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 22:06:41,791 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:41,791 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 22:06:41,791 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:41,795 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 22:06:41,797 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 22:06:41,797 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 22:06:41,797 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:41,797 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 22:06:41,797 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 22:06:41,797 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 22:06:41,797 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 22:06:41,797 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 22:06:41,798 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 22:06:41,798 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 22:06:41,799 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 22:06:41,801 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,801 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,801 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:41,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:41,802 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,802 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:41,801 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,802 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:41,802 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:41,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:41,802 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:41,803 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,803 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:41,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-22 22:06:41,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@654cc3a5[Count = 1] remaining members to acquire global barrier 2023-07-22 22:06:41,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:41,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:41,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:41,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:41,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:41,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:41,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:41,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-22 22:06:41,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@654cc3a5[Count = 0] remaining members to acquire global barrier 2023-07-22 22:06:41,808 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 22:06:41,808 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,810 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,810 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,810 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,810 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:06:41,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,810 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 22:06:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,810 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36573,1690063572179' in zk 2023-07-22 22:06:41,810 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,810 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:06:41,811 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:06:41,811 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:41,811 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:41,811 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:41,811 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,811 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. started... 2023-07-22 22:06:41,811 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:41,811 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:41,811 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:06:41,811 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. 2023-07-22 22:06:41,811 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2745): Flushing af5ff9c801e41e0dfd8cc4c7e04d37b2 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-22 22:06:41,811 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. started... 2023-07-22 22:06:41,812 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c49bf6c977a00fb6c482a850dfddbde3 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-22 22:06:41,812 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 22:06:41,812 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:41,812 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 22:06:41,838 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:41,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:06:41,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:41,842 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:06:41,851 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/.tmp/cf/c722e4075dc44c158e6dffb38026023d 2023-07-22 22:06:41,851 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/.tmp/cf/122acf0c154c4f0288a2752366ca8bfd 2023-07-22 22:06:41,863 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/.tmp/cf/c722e4075dc44c158e6dffb38026023d as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/cf/c722e4075dc44c158e6dffb38026023d 2023-07-22 22:06:41,867 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/.tmp/cf/122acf0c154c4f0288a2752366ca8bfd as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/cf/122acf0c154c4f0288a2752366ca8bfd 2023-07-22 22:06:41,877 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/cf/122acf0c154c4f0288a2752366ca8bfd, entries=47, sequenceid=6, filesize=8.0 K 2023-07-22 22:06:41,878 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/cf/c722e4075dc44c158e6dffb38026023d, entries=3, sequenceid=6, filesize=5.0 K 2023-07-22 22:06:41,880 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for c49bf6c977a00fb6c482a850dfddbde3 in 68ms, sequenceid=6, compaction requested=false 2023-07-22 22:06:41,880 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-22 22:06:41,880 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c49bf6c977a00fb6c482a850dfddbde3: 2023-07-22 22:06:41,881 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-22 22:06:41,881 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:41,881 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/cf/122acf0c154c4f0288a2752366ca8bfd] hfiles 2023-07-22 22:06:41,881 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/cf/122acf0c154c4f0288a2752366ca8bfd for snapshot=snaptb0-testExportFileSystemState 2023-07-22 22:06:41,882 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for af5ff9c801e41e0dfd8cc4c7e04d37b2 in 71ms, sequenceid=6, compaction requested=false 2023-07-22 22:06:41,884 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af5ff9c801e41e0dfd8cc4c7e04d37b2: 2023-07-22 22:06:41,884 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-22 22:06:41,884 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:41,884 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/cf/c722e4075dc44c158e6dffb38026023d] hfiles 2023-07-22 22:06:41,885 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/cf/c722e4075dc44c158e6dffb38026023d for snapshot=snaptb0-testExportFileSystemState 2023-07-22 22:06:41,919 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. completed. 2023-07-22 22:06:41,919 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. 2023-07-22 22:06:41,919 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:41,919 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:41,919 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,920 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 22:06:41,920 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34749,1690063572232' in zk 2023-07-22 22:06:41,922 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. completed. 2023-07-22 22:06:41,922 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:41,922 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:41,922 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:41,922 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,922 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 22:06:41,923 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38207,1690063572104' in zk 2023-07-22 22:06:41,925 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 22:06:41,925 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,925 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:41,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:41,926 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 22:06:41,928 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,928 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 22:06:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:41,928 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:41,928 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 22:06:41,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:41,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:41,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:41,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:41,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:41,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:41,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34749,1690063572232': 2023-07-22 22:06:41,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 22:06:41,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:41,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:41,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:41,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:41,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:41,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:41,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:41,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:41,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:41,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38207,1690063572104': 2023-07-22 22:06:41,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 22:06:41,941 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-22 22:06:41,942 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:06:41,942 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:06:41,942 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-22 22:06:41,942 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:06:41,943 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,943 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,944 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,944 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:41,944 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:41,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:41,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:41,943 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,944 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:41,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:41,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:41,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:41,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:41,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:41,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:41,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:41,945 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:41,946 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:41,947 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:41,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:41,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:41,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:41,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 22:06:41,949 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,950 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,950 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:41,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:41,955 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:41,955 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:41,955 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:41,955 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:41,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:41,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:41,955 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:41,956 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:41,956 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-22 22:06:41,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:41,955 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:41,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:41,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-22 22:06:41,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:41,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:41,956 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:41,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:41,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:41,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:41,956 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:41,959 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,959 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,959 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,959 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:41,960 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,960 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:41,960 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:41,960 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,960 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 22:06:41,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:41,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:41,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,024 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-22 22:06:42,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,024 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690063601737Consolidate snapshot: snaptb0-testExportFileSystemState at 1690063601956 (+219 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1690063601956Writing data manifest for snaptb0-testExportFileSystemState at 1690063601963 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690063601977 (+14 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690063602024 (+47 ms) 2023-07-22 22:06:42,027 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 22:06:42,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 283 msec 2023-07-22 22:06:42,042 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:42,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:06:42,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:06:42,045 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063602045 2023-07-22 22:06:42,045 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37905, tgtDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063602045, rawTgtDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063602045, srcFsUri=hdfs://localhost:37905, srcDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:06:42,072 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37905, inputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:06:42,072 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1509206953_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063602045, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063602045/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,072 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37905, inputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3, snapshotDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-22 22:06:42,087 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063602045/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 22:06:42,136 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,136 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,137 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,137 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,137 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,138 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,138 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,217 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/hadoop-6635450483426170067.jar 2023-07-22 22:06:42,217 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,218 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,218 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,219 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,219 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,220 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:42,220 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 22:06:42,220 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 22:06:42,221 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 22:06:42,221 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 22:06:42,222 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 22:06:42,223 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 22:06:42,223 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 22:06:42,223 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 22:06:42,224 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 22:06:42,224 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 22:06:42,225 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:42,225 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:42,226 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:42,226 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:42,226 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:42,227 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:42,227 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:42,876 WARN [Listener at jenkins-hbase4.apache.org/35991] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 22:06:42,878 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-22 22:06:42,881 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-22 22:06:44,336 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:06:44,338 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:06:44,343 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0001_000001 (auth:SIMPLE) 2023-07-22 22:06:44,641 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0002_000001 (auth:SIMPLE) 2023-07-22 22:06:45,062 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:06:49,189 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0002_000001 (auth:SIMPLE) 2023-07-22 22:06:51,414 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0002_000001 (auth:SIMPLE) 2023-07-22 22:06:54,805 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0002_000001 (auth:SIMPLE) 2023-07-22 22:06:56,140 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 22:06:56,141 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 22:06:56,148 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-22 22:06:56,148 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 22:06:56,149 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 22:06:56,149 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2071152985_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 22:06:56,149 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-22 22:06:56,149 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-22 22:06:56,149 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2071152985_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063602045/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063602045/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 22:06:56,150 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063602045/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-22 22:06:56,150 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063602045/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-22 22:06:56,158 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-22 22:06:56,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-22 22:06:56,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:56,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 22:06:56,164 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063616163"}]},"ts":"1690063616163"} 2023-07-22 22:06:56,165 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-22 22:06:56,167 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-22 22:06:56,167 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=af5ff9c801e41e0dfd8cc4c7e04d37b2, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c49bf6c977a00fb6c482a850dfddbde3, UNASSIGN}] 2023-07-22 22:06:56,169 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c49bf6c977a00fb6c482a850dfddbde3, UNASSIGN 2023-07-22 22:06:56,170 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=af5ff9c801e41e0dfd8cc4c7e04d37b2, UNASSIGN 2023-07-22 22:06:56,170 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c49bf6c977a00fb6c482a850dfddbde3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:56,170 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063616170"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063616170"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063616170"}]},"ts":"1690063616170"} 2023-07-22 22:06:56,171 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=af5ff9c801e41e0dfd8cc4c7e04d37b2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:56,171 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063616170"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063616170"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063616170"}]},"ts":"1690063616170"} 2023-07-22 22:06:56,172 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure c49bf6c977a00fb6c482a850dfddbde3, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:06:56,173 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure af5ff9c801e41e0dfd8cc4c7e04d37b2, server=jenkins-hbase4.apache.org,38207,1690063572104}] 2023-07-22 22:06:56,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 22:06:56,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c49bf6c977a00fb6c482a850dfddbde3 2023-07-22 22:06:56,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c49bf6c977a00fb6c482a850dfddbde3, disabling compactions & flushes 2023-07-22 22:06:56,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close af5ff9c801e41e0dfd8cc4c7e04d37b2 2023-07-22 22:06:56,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. 2023-07-22 22:06:56,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. 2023-07-22 22:06:56,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. after waiting 0 ms 2023-07-22 22:06:56,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. 2023-07-22 22:06:56,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing af5ff9c801e41e0dfd8cc4c7e04d37b2, disabling compactions & flushes 2023-07-22 22:06:56,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:56,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:56,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. after waiting 0 ms 2023-07-22 22:06:56,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:56,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:06:56,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:06:56,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:06:56,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:06:56,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3. 2023-07-22 22:06:56,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c49bf6c977a00fb6c482a850dfddbde3: 2023-07-22 22:06:56,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2. 2023-07-22 22:06:56,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for af5ff9c801e41e0dfd8cc4c7e04d37b2: 2023-07-22 22:06:56,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c49bf6c977a00fb6c482a850dfddbde3 2023-07-22 22:06:56,345 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c49bf6c977a00fb6c482a850dfddbde3, regionState=CLOSED 2023-07-22 22:06:56,345 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063616345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063616345"}]},"ts":"1690063616345"} 2023-07-22 22:06:56,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed af5ff9c801e41e0dfd8cc4c7e04d37b2 2023-07-22 22:06:56,346 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=af5ff9c801e41e0dfd8cc4c7e04d37b2, regionState=CLOSED 2023-07-22 22:06:56,346 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690063616345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063616345"}]},"ts":"1690063616345"} 2023-07-22 22:06:56,349 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-22 22:06:56,349 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure c49bf6c977a00fb6c482a850dfddbde3, server=jenkins-hbase4.apache.org,34749,1690063572232 in 175 msec 2023-07-22 22:06:56,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-22 22:06:56,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure af5ff9c801e41e0dfd8cc4c7e04d37b2, server=jenkins-hbase4.apache.org,38207,1690063572104 in 175 msec 2023-07-22 22:06:56,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c49bf6c977a00fb6c482a850dfddbde3, UNASSIGN in 182 msec 2023-07-22 22:06:56,351 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-22 22:06:56,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=af5ff9c801e41e0dfd8cc4c7e04d37b2, UNASSIGN in 183 msec 2023-07-22 22:06:56,352 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063616352"}]},"ts":"1690063616352"} 2023-07-22 22:06:56,353 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-22 22:06:56,355 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-22 22:06:56,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 197 msec 2023-07-22 22:06:56,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 22:06:56,465 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-22 22:06:56,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-22 22:06:56,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:56,470 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:56,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-22 22:06:56,471 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:56,472 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36573] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-22 22:06:56,476 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2 2023-07-22 22:06:56,476 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3 2023-07-22 22:06:56,476 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:56,476 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:56,476 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:56,476 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:56,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 22:06:56,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 22:06:56,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 22:06:56,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 22:06:56,478 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:56,478 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:56,478 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:56,478 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:56,478 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:56,478 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:56,478 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 22:06:56,478 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:56,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-22 22:06:56,482 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/cf, FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/recovered.edits] 2023-07-22 22:06:56,483 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/cf, FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/recovered.edits] 2023-07-22 22:06:56,487 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/cf/122acf0c154c4f0288a2752366ca8bfd to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/cf/122acf0c154c4f0288a2752366ca8bfd 2023-07-22 22:06:56,487 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/cf/c722e4075dc44c158e6dffb38026023d to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/cf/c722e4075dc44c158e6dffb38026023d 2023-07-22 22:06:56,490 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/recovered.edits/9.seqid to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3/recovered.edits/9.seqid 2023-07-22 22:06:56,490 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/recovered.edits/9.seqid to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2/recovered.edits/9.seqid 2023-07-22 22:06:56,491 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/c49bf6c977a00fb6c482a850dfddbde3 2023-07-22 22:06:56,491 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemState/af5ff9c801e41e0dfd8cc4c7e04d37b2 2023-07-22 22:06:56,491 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-22 22:06:56,494 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:56,496 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-22 22:06:56,498 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-22 22:06:56,499 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:56,499 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-22 22:06:56,499 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063616499"}]},"ts":"9223372036854775807"} 2023-07-22 22:06:56,500 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063616499"}]},"ts":"9223372036854775807"} 2023-07-22 22:06:56,501 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 22:06:56,501 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => af5ff9c801e41e0dfd8cc4c7e04d37b2, NAME => 'testtb-testExportFileSystemState,,1690063599793.af5ff9c801e41e0dfd8cc4c7e04d37b2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c49bf6c977a00fb6c482a850dfddbde3, NAME => 'testtb-testExportFileSystemState,1,1690063599793.c49bf6c977a00fb6c482a850dfddbde3.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 22:06:56,501 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-22 22:06:56,501 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690063616501"}]},"ts":"9223372036854775807"} 2023-07-22 22:06:56,503 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-22 22:06:56,505 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 22:06:56,506 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 39 msec 2023-07-22 22:06:56,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-22 22:06:56,580 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-22 22:06:56,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-22 22:06:56,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-22 22:06:56,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-22 22:06:56,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-22 22:06:56,621 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=766 (was 753) Potentially hanging thread: Thread-1945 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:43111 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2071152985_17 at /127.0.0.1:36276 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:44447 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2071152985_17 at /127.0.0.1:40096 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1683519092_1 at /127.0.0.1:40076 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2071152985_17 at /127.0.0.1:52004 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=933 (was 917) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=312 (was 309) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 179), AvailableMemoryMB=6452 (was 6671) 2023-07-22 22:06:56,621 WARN [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-22 22:06:56,641 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=178, AvailableMemoryMB=6451 2023-07-22 22:06:56,641 WARN [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-22 22:06:56,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 22:06:56,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:06:56,645 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:06:56,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-22 22:06:56,646 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:06:56,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 22:06:56,649 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92 2023-07-22 22:06:56,649 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e 2023-07-22 22:06:56,650 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92 empty. 2023-07-22 22:06:56,650 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e empty. 2023-07-22 22:06:56,650 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92 2023-07-22 22:06:56,650 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e 2023-07-22 22:06:56,650 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-22 22:06:56,661 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-22 22:06:56,662 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => e50f584bd8da086d5fa05cdbe0182a9e, NAME => 'testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:06:56,662 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7c39b367f973bbe0b45b7dfc5fc27f92, NAME => 'testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:06:56,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 22:06:56,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 22:06:57,087 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:57,088 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 7c39b367f973bbe0b45b7dfc5fc27f92, disabling compactions & flushes 2023-07-22 22:06:57,088 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:06:57,088 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:06:57,088 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. after waiting 0 ms 2023-07-22 22:06:57,088 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:06:57,088 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:06:57,088 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 7c39b367f973bbe0b45b7dfc5fc27f92: 2023-07-22 22:06:57,088 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:57,088 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing e50f584bd8da086d5fa05cdbe0182a9e, disabling compactions & flushes 2023-07-22 22:06:57,089 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. 2023-07-22 22:06:57,089 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. 2023-07-22 22:06:57,089 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. after waiting 0 ms 2023-07-22 22:06:57,089 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. 2023-07-22 22:06:57,089 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. 2023-07-22 22:06:57,089 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for e50f584bd8da086d5fa05cdbe0182a9e: 2023-07-22 22:06:57,092 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:06:57,093 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063617093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063617093"}]},"ts":"1690063617093"} 2023-07-22 22:06:57,093 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063617093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063617093"}]},"ts":"1690063617093"} 2023-07-22 22:06:57,095 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 22:06:57,096 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:06:57,096 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063617096"}]},"ts":"1690063617096"} 2023-07-22 22:06:57,098 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-22 22:06:57,102 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:06:57,103 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:06:57,103 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:06:57,103 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:06:57,103 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:06:57,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7c39b367f973bbe0b45b7dfc5fc27f92, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e50f584bd8da086d5fa05cdbe0182a9e, ASSIGN}] 2023-07-22 22:06:57,107 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7c39b367f973bbe0b45b7dfc5fc27f92, ASSIGN 2023-07-22 22:06:57,107 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e50f584bd8da086d5fa05cdbe0182a9e, ASSIGN 2023-07-22 22:06:57,107 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e50f584bd8da086d5fa05cdbe0182a9e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34749,1690063572232; forceNewPlan=false, retain=false 2023-07-22 22:06:57,108 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7c39b367f973bbe0b45b7dfc5fc27f92, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38207,1690063572104; forceNewPlan=false, retain=false 2023-07-22 22:06:57,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 22:06:57,258 INFO [jenkins-hbase4:33185] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 22:06:57,260 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=e50f584bd8da086d5fa05cdbe0182a9e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,260 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7c39b367f973bbe0b45b7dfc5fc27f92, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,261 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063617260"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063617260"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063617260"}]},"ts":"1690063617260"} 2023-07-22 22:06:57,261 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063617260"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063617260"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063617260"}]},"ts":"1690063617260"} 2023-07-22 22:06:57,262 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure e50f584bd8da086d5fa05cdbe0182a9e, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:06:57,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 7c39b367f973bbe0b45b7dfc5fc27f92, server=jenkins-hbase4.apache.org,38207,1690063572104}] 2023-07-22 22:06:57,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. 2023-07-22 22:06:57,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e50f584bd8da086d5fa05cdbe0182a9e, NAME => 'testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 22:06:57,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:06:57,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7c39b367f973bbe0b45b7dfc5fc27f92, NAME => 'testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 22:06:57,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. service=AccessControlService 2023-07-22 22:06:57,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. service=AccessControlService 2023-07-22 22:06:57,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:57,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports e50f584bd8da086d5fa05cdbe0182a9e 2023-07-22 22:06:57,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:06:57,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:57,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e50f584bd8da086d5fa05cdbe0182a9e 2023-07-22 22:06:57,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7c39b367f973bbe0b45b7dfc5fc27f92 2023-07-22 22:06:57,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e50f584bd8da086d5fa05cdbe0182a9e 2023-07-22 22:06:57,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:06:57,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7c39b367f973bbe0b45b7dfc5fc27f92 2023-07-22 22:06:57,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7c39b367f973bbe0b45b7dfc5fc27f92 2023-07-22 22:06:57,421 INFO [StoreOpener-e50f584bd8da086d5fa05cdbe0182a9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e50f584bd8da086d5fa05cdbe0182a9e 2023-07-22 22:06:57,427 INFO [StoreOpener-7c39b367f973bbe0b45b7dfc5fc27f92-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7c39b367f973bbe0b45b7dfc5fc27f92 2023-07-22 22:06:57,428 DEBUG [StoreOpener-e50f584bd8da086d5fa05cdbe0182a9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/cf 2023-07-22 22:06:57,428 DEBUG [StoreOpener-e50f584bd8da086d5fa05cdbe0182a9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/cf 2023-07-22 22:06:57,428 DEBUG [StoreOpener-7c39b367f973bbe0b45b7dfc5fc27f92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/cf 2023-07-22 22:06:57,428 DEBUG [StoreOpener-7c39b367f973bbe0b45b7dfc5fc27f92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/cf 2023-07-22 22:06:57,428 INFO [StoreOpener-e50f584bd8da086d5fa05cdbe0182a9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e50f584bd8da086d5fa05cdbe0182a9e columnFamilyName cf 2023-07-22 22:06:57,428 INFO [StoreOpener-7c39b367f973bbe0b45b7dfc5fc27f92-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c39b367f973bbe0b45b7dfc5fc27f92 columnFamilyName cf 2023-07-22 22:06:57,429 INFO [StoreOpener-e50f584bd8da086d5fa05cdbe0182a9e-1] regionserver.HStore(310): Store=e50f584bd8da086d5fa05cdbe0182a9e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:57,429 INFO [StoreOpener-7c39b367f973bbe0b45b7dfc5fc27f92-1] regionserver.HStore(310): Store=7c39b367f973bbe0b45b7dfc5fc27f92/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:06:57,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e 2023-07-22 22:06:57,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92 2023-07-22 22:06:57,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e 2023-07-22 22:06:57,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92 2023-07-22 22:06:57,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e50f584bd8da086d5fa05cdbe0182a9e 2023-07-22 22:06:57,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7c39b367f973bbe0b45b7dfc5fc27f92 2023-07-22 22:06:57,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:57,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:06:57,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e50f584bd8da086d5fa05cdbe0182a9e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59633178, jitterRate=-0.11139640212059021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:57,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e50f584bd8da086d5fa05cdbe0182a9e: 2023-07-22 22:06:57,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7c39b367f973bbe0b45b7dfc5fc27f92; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70225484, jitterRate=0.04644125699996948}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:06:57,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7c39b367f973bbe0b45b7dfc5fc27f92: 2023-07-22 22:06:57,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e., pid=45, masterSystemTime=1690063617414 2023-07-22 22:06:57,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92., pid=46, masterSystemTime=1690063617415 2023-07-22 22:06:57,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. 2023-07-22 22:06:57,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. 2023-07-22 22:06:57,443 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=e50f584bd8da086d5fa05cdbe0182a9e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:06:57,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:06:57,443 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063617443"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063617443"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063617443"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063617443"}]},"ts":"1690063617443"} 2023-07-22 22:06:57,444 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7c39b367f973bbe0b45b7dfc5fc27f92, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,444 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063617444"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063617444"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063617444"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063617444"}]},"ts":"1690063617444"} 2023-07-22 22:06:57,447 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-22 22:06:57,447 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure e50f584bd8da086d5fa05cdbe0182a9e, server=jenkins-hbase4.apache.org,34749,1690063572232 in 183 msec 2023-07-22 22:06:57,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-22 22:06:57,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 7c39b367f973bbe0b45b7dfc5fc27f92, server=jenkins-hbase4.apache.org,38207,1690063572104 in 183 msec 2023-07-22 22:06:57,449 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e50f584bd8da086d5fa05cdbe0182a9e, ASSIGN in 343 msec 2023-07-22 22:06:57,450 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-22 22:06:57,450 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7c39b367f973bbe0b45b7dfc5fc27f92, ASSIGN in 344 msec 2023-07-22 22:06:57,451 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:06:57,451 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063617451"}]},"ts":"1690063617451"} 2023-07-22 22:06:57,453 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-22 22:06:57,455 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:06:57,455 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-22 22:06:57,458 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36573] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 22:06:57,460 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:57,460 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:57,460 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:57,460 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:06:57,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:57,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:57,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:57,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 22:06:57,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 819 msec 2023-07-22 22:06:57,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 22:06:57,752 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-22 22:06:57,752 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-22 22:06:57,752 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:57,755 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-22 22:06:57,756 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:57,756 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-22 22:06:57,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 22:06:57,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063617759 (current time:1690063617759). 2023-07-22 22:06:57,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:06:57,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x645b996e to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:57,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b37356a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:57,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:57,770 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:57,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x645b996e to 127.0.0.1:64066 2023-07-22 22:06:57,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:57,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x092e7022 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:57,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31061880, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:57,777 DEBUG [hconnection-0x13b8e7af-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:57,780 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:57,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:57,785 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:57,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x092e7022 to 127.0.0.1:64066 2023-07-22 22:06:57,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:57,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 22:06:57,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:06:57,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 22:06:57,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 22:06:57,791 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 22:06:57,791 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690064217791 2023-07-22 22:06:57,791 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-22 22:06:57,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 22:06:57,793 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:06:57,793 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:06:57,794 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 22:06:57,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 22:06:57,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-22 22:06:57,796 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 22:06:57,797 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690064217797 2023-07-22 22:06:57,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,813 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-22 22:06:57,813 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:57,814 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-22 22:06:57,814 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-22 22:06:57,814 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,814 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,816 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:57,816 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:57,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:57,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:57,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:57,816 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:57,816 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:57,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:57,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:57,817 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,817 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,817 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,818 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:06:57,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 22:06:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 22:06:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 22:06:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,818 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 22:06:57,818 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 22:06:57,818 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 22:06:57,818 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,819 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,819 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,819 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 22:06:57,819 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 22:06:57,819 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 22:06:57,819 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:57,819 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:57,820 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 22:06:57,821 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 22:06:57,821 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 22:06:57,819 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:57,821 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 22:06:57,821 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 22:06:57,824 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 22:06:57,824 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 22:06:57,824 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 22:06:57,824 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 22:06:57,826 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,826 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,826 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:57,826 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,827 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,827 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,827 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:57,827 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,827 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,827 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:57,827 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:57,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-22 22:06:57,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38b18fb8[Count = 1] remaining members to acquire global barrier 2023-07-22 22:06:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:57,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:57,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:57,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-22 22:06:57,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38b18fb8[Count = 0] remaining members to acquire global barrier 2023-07-22 22:06:57,832 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-22 22:06:57,833 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,834 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,834 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,834 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,834 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 22:06:57,834 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,834 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 22:06:57,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,834 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. 2023-07-22 22:06:57,835 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 22:06:57,835 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. started... 2023-07-22 22:06:57,835 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,835 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:06:57,835 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 22:06:57,835 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36573,1690063572179' in zk 2023-07-22 22:06:57,834 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:57,835 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:57,842 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:57,844 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:06:57,844 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. started... 2023-07-22 22:06:57,844 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:57,844 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 22:06:57,844 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:57,844 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 22:06:57,846 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e50f584bd8da086d5fa05cdbe0182a9e: 2023-07-22 22:06:57,846 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,846 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:57,846 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:06:57,846 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7c39b367f973bbe0b45b7dfc5fc27f92: 2023-07-22 22:06:57,847 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,847 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:57,847 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:06:57,871 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. completed. 2023-07-22 22:06:57,872 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:06:57,872 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:57,872 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:57,872 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,872 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 22:06:57,872 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38207,1690063572104' in zk 2023-07-22 22:06:57,874 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. completed. 2023-07-22 22:06:57,874 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. 2023-07-22 22:06:57,874 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:57,874 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:57,874 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,874 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 22:06:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 22:06:57,874 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 22:06:57,875 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,876 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34749,1690063572232' in zk 2023-07-22 22:06:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:57,878 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,878 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 22:06:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:57,878 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:57,878 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 22:06:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:57,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:57,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:57,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38207,1690063572104': 2023-07-22 22:06:57,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-22 22:06:57,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:57,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34749,1690063572232': 2023-07-22 22:06:57,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-22 22:06:57,885 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-22 22:06:57,885 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:06:57,885 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:06:57,885 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,885 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:06:57,886 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,886 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,886 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:57,886 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:57,886 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,886 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:57,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:57,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,887 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:57,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:57,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,887 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:57,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:57,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:57,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:57,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:57,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:57,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,888 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,889 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:57,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:57,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:57,890 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:57,891 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,891 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:57,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:57,893 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:57,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 22:06:57,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:57,894 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:06:57,895 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:57,895 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:57,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:57,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:57,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:57,895 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:57,895 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:57,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:57,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:57,895 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,895 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,895 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:57,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,895 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:57,895 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:57,895 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:57,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:57,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:57,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:57,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:57,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:57,895 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,897 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,897 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,897 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:57,897 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,897 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:57,897 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:57,897 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,897 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:57,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:57,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:57,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,094 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:58,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 22:06:58,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:58,096 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 22:06:58,350 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-22 22:06:58,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,351 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 22:06:58,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690063617792Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690063617895 (+103 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690063617896 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690063617901 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690063617916 (+15 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690063618350 (+434 ms) 2023-07-22 22:06:58,357 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 22:06:58,359 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 565 msec 2023-07-22 22:06:58,396 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:58,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 22:06:58,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:06:58,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38207] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:06:58,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:06:58,421 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-22 22:06:58,421 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:06:58,422 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:06:58,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 22:06:58,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063618442 (current time:1690063618442). 2023-07-22 22:06:58,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:06:58,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x7a7501f6 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:58,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7da0570c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:58,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:58,464 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:58,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a7501f6 to 127.0.0.1:64066 2023-07-22 22:06:58,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:58,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x21813484 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:06:58,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73a9fbf3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:06:58,491 DEBUG [hconnection-0xccedabd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:58,492 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:58,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:06:58,497 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:06:58,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21813484 to 127.0.0.1:64066 2023-07-22 22:06:58,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:06:58,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 22:06:58,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:06:58,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 22:06:58,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 22:06:58,503 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 22:06:58,504 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690064218504 2023-07-22 22:06:58,504 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-22 22:06:58,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 22:06:58,506 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:06:58,506 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:06:58,509 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 22:06:58,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 22:06:58,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-22 22:06:58,511 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 22:06:58,513 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690064218513 2023-07-22 22:06:58,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-22 22:06:58,550 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-22 22:06:58,550 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:58,552 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-22 22:06:58,552 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-22 22:06:58,553 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,553 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,555 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,555 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,555 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,555 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,556 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,556 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:06:58,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 22:06:58,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,556 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 22:06:58,557 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 22:06:58,557 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 22:06:58,557 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:58,558 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 22:06:58,558 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 22:06:58,558 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 22:06:58,559 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,559 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,560 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,560 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:58,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:58,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,560 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,560 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:58,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:58,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 22:06:58,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:58,561 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 22:06:58,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 22:06:58,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 22:06:58,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,561 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 22:06:58,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,561 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:58,562 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 22:06:58,563 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 22:06:58,563 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 22:06:58,563 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 22:06:58,563 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 22:06:58,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,563 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 22:06:58,563 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:06:58,564 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 22:06:58,564 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 22:06:58,564 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 22:06:58,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:58,566 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,566 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-22 22:06:58,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26fdbb90[Count = 1] remaining members to acquire global barrier 2023-07-22 22:06:58,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:58,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:58,568 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,568 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:58,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:58,568 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:58,568 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,572 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:06:58,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:58,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:58,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-22 22:06:58,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26fdbb90[Count = 0] remaining members to acquire global barrier 2023-07-22 22:06:58,575 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-22 22:06:58,575 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,577 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,577 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,577 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,577 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 22:06:58,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,577 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 22:06:58,577 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,578 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 22:06:58,578 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 22:06:58,578 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36573,1690063572179' in zk 2023-07-22 22:06:58,578 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:06:58,578 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:58,578 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. started... 2023-07-22 22:06:58,578 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:58,578 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,578 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:06:58,578 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7c39b367f973bbe0b45b7dfc5fc27f92 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-22 22:06:58,580 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 22:06:58,580 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:58,580 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 22:06:58,584 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:06:58,584 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:06:58,584 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. 2023-07-22 22:06:58,584 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. started... 2023-07-22 22:06:58,584 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e50f584bd8da086d5fa05cdbe0182a9e 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-22 22:06:58,607 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:58,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 22:06:58,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:06:58,608 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:06:58,635 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/.tmp/cf/d6c1818880964a398c071c11fe442366 2023-07-22 22:06:58,639 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/.tmp/cf/f4274c2b146e4a1a92fc2a0d28e7ead8 2023-07-22 22:06:58,650 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/.tmp/cf/f4274c2b146e4a1a92fc2a0d28e7ead8 as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/cf/f4274c2b146e4a1a92fc2a0d28e7ead8 2023-07-22 22:06:58,651 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/.tmp/cf/d6c1818880964a398c071c11fe442366 as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/cf/d6c1818880964a398c071c11fe442366 2023-07-22 22:06:58,657 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/cf/d6c1818880964a398c071c11fe442366, entries=5, sequenceid=6, filesize=5.2 K 2023-07-22 22:06:58,658 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/cf/f4274c2b146e4a1a92fc2a0d28e7ead8, entries=45, sequenceid=6, filesize=7.9 K 2023-07-22 22:06:58,659 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 7c39b367f973bbe0b45b7dfc5fc27f92 in 81ms, sequenceid=6, compaction requested=false 2023-07-22 22:06:58,659 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-22 22:06:58,659 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for e50f584bd8da086d5fa05cdbe0182a9e in 75ms, sequenceid=6, compaction requested=false 2023-07-22 22:06:58,659 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-22 22:06:58,661 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7c39b367f973bbe0b45b7dfc5fc27f92: 2023-07-22 22:06:58,661 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e50f584bd8da086d5fa05cdbe0182a9e: 2023-07-22 22:06:58,661 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-22 22:06:58,661 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-22 22:06:58,661 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:58,662 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:06:58,662 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/cf/d6c1818880964a398c071c11fe442366] hfiles 2023-07-22 22:06:58,662 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/cf/f4274c2b146e4a1a92fc2a0d28e7ead8] hfiles 2023-07-22 22:06:58,662 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/cf/d6c1818880964a398c071c11fe442366 for snapshot=snaptb0-testConsecutiveExports 2023-07-22 22:06:58,662 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/cf/f4274c2b146e4a1a92fc2a0d28e7ead8 for snapshot=snaptb0-testConsecutiveExports 2023-07-22 22:06:58,684 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. completed. 2023-07-22 22:06:58,684 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:06:58,684 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:58,684 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:58,684 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,685 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 22:06:58,685 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38207,1690063572104' in zk 2023-07-22 22:06:58,686 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:58,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:58,687 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 22:06:58,687 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:58,687 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 22:06:58,691 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. completed. 2023-07-22 22:06:58,691 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. 2023-07-22 22:06:58,691 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:06:58,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:58,691 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:06:58,691 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,691 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 22:06:58,691 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34749,1690063572232' in zk 2023-07-22 22:06:58,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:58,694 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 22:06:58,694 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,694 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:58,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,694 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 22:06:58,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:58,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:58,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:58,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38207,1690063572104': 2023-07-22 22:06:58,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-22 22:06:58,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:58,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:58,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:58,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:58,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:58,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:58,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:58,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34749,1690063572232': 2023-07-22 22:06:58,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-22 22:06:58,704 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-22 22:06:58,704 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:06:58,704 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:06:58,704 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-22 22:06:58,704 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:06:58,706 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,706 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,706 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:06:58,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:06:58,706 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,706 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,706 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,706 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:06:58,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,706 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,708 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,709 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:58,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:06:58,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:58,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:06:58,711 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 22:06:58,711 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,712 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:58,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:58,717 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:58,717 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,717 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,717 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,718 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,718 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:06:58,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,718 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-22 22:06:58,718 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:06:58,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-22 22:06:58,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,718 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,720 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,720 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,720 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:06:58,720 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,720 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:06:58,720 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:06:58,720 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,720 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,718 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:06:58,718 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:06:58,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:06:58,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:06:58,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:06:58,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-22 22:06:58,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,766 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690063618505Consolidate snapshot: snaptb0-testConsecutiveExports at 1690063618718 (+213 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1690063618720 (+2 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1690063618724 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690063618736 (+12 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690063618766 (+30 ms) 2023-07-22 22:06:58,769 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 22:06:58,770 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 261 msec 2023-07-22 22:06:58,808 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:06:58,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 22:06:58,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:06:58,810 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809 2023-07-22 22:06:58,810 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809, srcFsUri=hdfs://localhost:37905, srcDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:06:58,831 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37905, inputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:06:58,831 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7229143b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,832 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37905, inputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3, snapshotDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-22 22:06:58,839 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 22:06:58,858 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:58,859 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:58,859 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:58,860 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:58,860 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:58,860 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:58,860 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:58,932 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/hadoop-1364552787850553529.jar 2023-07-22 22:06:58,932 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:58,933 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:58,933 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:58,933 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:58,934 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:58,934 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 22:06:58,934 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 22:06:58,935 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 22:06:58,935 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 22:06:58,935 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 22:06:58,936 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 22:06:58,936 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 22:06:58,936 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 22:06:58,937 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 22:06:58,937 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 22:06:58,938 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 22:06:58,938 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:58,938 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:58,939 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:58,939 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:58,939 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:06:58,940 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:58,940 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:06:59,300 WARN [Listener at jenkins-hbase4.apache.org/35991] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 22:06:59,302 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-22 22:06:59,304 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-22 22:07:00,988 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:00,988 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:00,991 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0002_000001 (auth:SIMPLE) 2023-07-22 22:07:01,726 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0003_000001 (auth:SIMPLE) 2023-07-22 22:07:01,921 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:07:06,226 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0003_000001 (auth:SIMPLE) 2023-07-22 22:07:08,449 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0003_000001 (auth:SIMPLE) 2023-07-22 22:07:11,151 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0003_000001 (auth:SIMPLE) 2023-07-22 22:07:12,502 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 22:07:12,503 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 22:07:12,506 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-22 22:07:12,506 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 22:07:12,507 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 22:07:12,507 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2071152985_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 22:07:12,509 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 22:07:12,509 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 22:07:12,509 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5e0b4e7e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 22:07:12,510 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 22:07:12,510 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 22:07:12,511 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809, srcFsUri=hdfs://localhost:37905, srcDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:07:12,532 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37905, inputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:07:12,532 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@43b3c694, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 22:07:12,532 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37905, inputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3, snapshotDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-22 22:07:12,543 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 22:07:12,555 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:12,556 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:12,556 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:12,557 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:12,557 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:12,558 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:12,558 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:12,628 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/hadoop-3882480247890606643.jar 2023-07-22 22:07:12,628 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:12,629 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:12,629 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:12,629 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:12,630 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:12,630 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:12,630 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 22:07:12,631 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 22:07:12,631 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 22:07:12,631 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 22:07:12,632 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 22:07:12,632 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 22:07:12,632 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 22:07:12,633 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 22:07:12,633 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 22:07:12,633 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 22:07:12,634 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:12,634 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:12,635 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:12,635 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:12,635 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:12,635 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:12,636 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:12,995 WARN [Listener at jenkins-hbase4.apache.org/35991] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 22:07:12,997 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-22 22:07:12,999 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-22 22:07:17,339 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:17,340 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:17,342 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0003_000001 (auth:SIMPLE) 2023-07-22 22:07:18,002 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0004_000001 (auth:SIMPLE) 2023-07-22 22:07:22,487 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0004_000001 (auth:SIMPLE) 2023-07-22 22:07:24,710 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0004_000001 (auth:SIMPLE) 2023-07-22 22:07:28,039 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0004_000001 (auth:SIMPLE) 2023-07-22 22:07:29,275 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 22:07:29,275 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 22:07:29,279 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-22 22:07:29,279 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 22:07:29,280 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 22:07:29,280 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2071152985_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 22:07:29,295 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 22:07:29,296 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 22:07:29,296 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5e0b4e7e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 22:07:29,296 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 22:07:29,296 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/local-export-1690063618809/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 22:07:29,356 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-22 22:07:29,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-22 22:07:29,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:07:29,364 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063649364"}]},"ts":"1690063649364"} 2023-07-22 22:07:29,366 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-22 22:07:29,368 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-22 22:07:29,369 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7c39b367f973bbe0b45b7dfc5fc27f92, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e50f584bd8da086d5fa05cdbe0182a9e, UNASSIGN}] 2023-07-22 22:07:29,371 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e50f584bd8da086d5fa05cdbe0182a9e, UNASSIGN 2023-07-22 22:07:29,372 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=e50f584bd8da086d5fa05cdbe0182a9e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:29,372 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063649372"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063649372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063649372"}]},"ts":"1690063649372"} 2023-07-22 22:07:29,374 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure e50f584bd8da086d5fa05cdbe0182a9e, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:07:29,396 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7c39b367f973bbe0b45b7dfc5fc27f92, UNASSIGN 2023-07-22 22:07:29,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 22:07:29,399 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7c39b367f973bbe0b45b7dfc5fc27f92, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:29,399 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063649399"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063649399"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063649399"}]},"ts":"1690063649399"} 2023-07-22 22:07:29,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 7c39b367f973bbe0b45b7dfc5fc27f92, server=jenkins-hbase4.apache.org,38207,1690063572104}] 2023-07-22 22:07:29,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 22:07:29,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e50f584bd8da086d5fa05cdbe0182a9e 2023-07-22 22:07:29,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e50f584bd8da086d5fa05cdbe0182a9e, disabling compactions & flushes 2023-07-22 22:07:29,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. 2023-07-22 22:07:29,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. 2023-07-22 22:07:29,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. after waiting 0 ms 2023-07-22 22:07:29,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. 2023-07-22 22:07:29,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7c39b367f973bbe0b45b7dfc5fc27f92 2023-07-22 22:07:29,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7c39b367f973bbe0b45b7dfc5fc27f92, disabling compactions & flushes 2023-07-22 22:07:29,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:07:29,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:07:29,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. after waiting 0 ms 2023-07-22 22:07:29,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:07:29,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:07:29,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:07:29,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e. 2023-07-22 22:07:29,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e50f584bd8da086d5fa05cdbe0182a9e: 2023-07-22 22:07:29,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e50f584bd8da086d5fa05cdbe0182a9e 2023-07-22 22:07:29,605 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=e50f584bd8da086d5fa05cdbe0182a9e, regionState=CLOSED 2023-07-22 22:07:29,605 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063649605"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063649605"}]},"ts":"1690063649605"} 2023-07-22 22:07:29,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-22 22:07:29,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure e50f584bd8da086d5fa05cdbe0182a9e, server=jenkins-hbase4.apache.org,34749,1690063572232 in 236 msec 2023-07-22 22:07:29,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e50f584bd8da086d5fa05cdbe0182a9e, UNASSIGN in 245 msec 2023-07-22 22:07:29,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:07:29,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:07:29,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92. 2023-07-22 22:07:29,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7c39b367f973bbe0b45b7dfc5fc27f92: 2023-07-22 22:07:29,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7c39b367f973bbe0b45b7dfc5fc27f92 2023-07-22 22:07:29,632 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7c39b367f973bbe0b45b7dfc5fc27f92, regionState=CLOSED 2023-07-22 22:07:29,632 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690063649632"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063649632"}]},"ts":"1690063649632"} 2023-07-22 22:07:29,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-22 22:07:29,637 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 7c39b367f973bbe0b45b7dfc5fc27f92, server=jenkins-hbase4.apache.org,38207,1690063572104 in 231 msec 2023-07-22 22:07:29,639 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-22 22:07:29,639 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7c39b367f973bbe0b45b7dfc5fc27f92, UNASSIGN in 268 msec 2023-07-22 22:07:29,639 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063649639"}]},"ts":"1690063649639"} 2023-07-22 22:07:29,641 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-22 22:07:29,643 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-22 22:07:29,646 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 287 msec 2023-07-22 22:07:29,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 22:07:29,702 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-22 22:07:29,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-22 22:07:29,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:07:29,712 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:07:29,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-22 22:07:29,717 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:07:29,718 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36573] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-22 22:07:29,721 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:29,721 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:29,721 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:29,721 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:29,722 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 22:07:29,722 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 22:07:29,722 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 22:07:29,722 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 22:07:29,723 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:29,723 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:29,723 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:29,723 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:29,724 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:29,723 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:29,724 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 22:07:29,724 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:29,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-22 22:07:29,735 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92 2023-07-22 22:07:29,741 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e 2023-07-22 22:07:29,743 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/cf, FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/recovered.edits] 2023-07-22 22:07:29,747 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/cf, FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/recovered.edits] 2023-07-22 22:07:29,753 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/cf/d6c1818880964a398c071c11fe442366 to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/cf/d6c1818880964a398c071c11fe442366 2023-07-22 22:07:29,764 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/cf/f4274c2b146e4a1a92fc2a0d28e7ead8 to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/cf/f4274c2b146e4a1a92fc2a0d28e7ead8 2023-07-22 22:07:29,766 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/recovered.edits/9.seqid to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92/recovered.edits/9.seqid 2023-07-22 22:07:29,767 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/7c39b367f973bbe0b45b7dfc5fc27f92 2023-07-22 22:07:29,770 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/recovered.edits/9.seqid to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e/recovered.edits/9.seqid 2023-07-22 22:07:29,771 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testConsecutiveExports/e50f584bd8da086d5fa05cdbe0182a9e 2023-07-22 22:07:29,771 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-22 22:07:29,774 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:07:29,787 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-22 22:07:29,791 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-22 22:07:29,793 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:07:29,793 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-22 22:07:29,793 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063649793"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:29,793 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063649793"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:29,800 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 22:07:29,800 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7c39b367f973bbe0b45b7dfc5fc27f92, NAME => 'testtb-testConsecutiveExports,,1690063616642.7c39b367f973bbe0b45b7dfc5fc27f92.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e50f584bd8da086d5fa05cdbe0182a9e, NAME => 'testtb-testConsecutiveExports,1,1690063616642.e50f584bd8da086d5fa05cdbe0182a9e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 22:07:29,800 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-22 22:07:29,800 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690063649800"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:29,814 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-22 22:07:29,818 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 22:07:29,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 116 msec 2023-07-22 22:07:29,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-22 22:07:29,827 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-22 22:07:29,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-22 22:07:29,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-22 22:07:29,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-22 22:07:29,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-22 22:07:29,935 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=748 (was 766), OpenFileDescriptor=896 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=430 (was 312) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=6280 (was 6451) 2023-07-22 22:07:29,935 WARN [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-22 22:07:29,966 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=430, ProcessCount=184, AvailableMemoryMB=6275 2023-07-22 22:07:29,966 WARN [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-22 22:07:29,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 22:07:29,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:29,979 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:07:29,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-22 22:07:29,980 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:07:29,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 22:07:29,985 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd 2023-07-22 22:07:29,986 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd empty. 2023-07-22 22:07:29,986 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40 2023-07-22 22:07:29,987 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd 2023-07-22 22:07:29,987 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40 empty. 2023-07-22 22:07:29,988 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40 2023-07-22 22:07:29,988 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-22 22:07:30,051 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-22 22:07:30,055 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 42e75ca1b66924ec92b92e644142fbcd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:07:30,069 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 73aeab55b49128ff81f70e16f52e9e40, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:07:30,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 22:07:30,188 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:30,188 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 73aeab55b49128ff81f70e16f52e9e40, disabling compactions & flushes 2023-07-22 22:07:30,188 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. 2023-07-22 22:07:30,188 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. 2023-07-22 22:07:30,188 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. after waiting 0 ms 2023-07-22 22:07:30,188 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. 2023-07-22 22:07:30,188 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. 2023-07-22 22:07:30,188 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 73aeab55b49128ff81f70e16f52e9e40: 2023-07-22 22:07:30,191 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:30,191 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 42e75ca1b66924ec92b92e644142fbcd, disabling compactions & flushes 2023-07-22 22:07:30,191 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:30,191 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:30,191 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. after waiting 0 ms 2023-07-22 22:07:30,191 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:30,191 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:30,192 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 42e75ca1b66924ec92b92e644142fbcd: 2023-07-22 22:07:30,203 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:07:30,204 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063650204"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063650204"}]},"ts":"1690063650204"} 2023-07-22 22:07:30,204 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063650204"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063650204"}]},"ts":"1690063650204"} 2023-07-22 22:07:30,213 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 22:07:30,216 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:07:30,216 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063650216"}]},"ts":"1690063650216"} 2023-07-22 22:07:30,219 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-22 22:07:30,223 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:07:30,224 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:07:30,224 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:07:30,225 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:07:30,225 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:07:30,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=42e75ca1b66924ec92b92e644142fbcd, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73aeab55b49128ff81f70e16f52e9e40, ASSIGN}] 2023-07-22 22:07:30,228 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73aeab55b49128ff81f70e16f52e9e40, ASSIGN 2023-07-22 22:07:30,228 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=42e75ca1b66924ec92b92e644142fbcd, ASSIGN 2023-07-22 22:07:30,230 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=42e75ca1b66924ec92b92e644142fbcd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34749,1690063572232; forceNewPlan=false, retain=false 2023-07-22 22:07:30,230 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73aeab55b49128ff81f70e16f52e9e40, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38207,1690063572104; forceNewPlan=false, retain=false 2023-07-22 22:07:30,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 22:07:30,380 INFO [jenkins-hbase4:33185] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 22:07:30,383 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=73aeab55b49128ff81f70e16f52e9e40, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:30,384 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063650383"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063650383"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063650383"}]},"ts":"1690063650383"} 2023-07-22 22:07:30,384 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=42e75ca1b66924ec92b92e644142fbcd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:30,384 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063650384"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063650384"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063650384"}]},"ts":"1690063650384"} 2023-07-22 22:07:30,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 73aeab55b49128ff81f70e16f52e9e40, server=jenkins-hbase4.apache.org,38207,1690063572104}] 2023-07-22 22:07:30,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 42e75ca1b66924ec92b92e644142fbcd, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:07:30,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:30,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 42e75ca1b66924ec92b92e644142fbcd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 22:07:30,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. service=AccessControlService 2023-07-22 22:07:30,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:07:30,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 42e75ca1b66924ec92b92e644142fbcd 2023-07-22 22:07:30,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:30,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 42e75ca1b66924ec92b92e644142fbcd 2023-07-22 22:07:30,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 42e75ca1b66924ec92b92e644142fbcd 2023-07-22 22:07:30,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. 2023-07-22 22:07:30,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 73aeab55b49128ff81f70e16f52e9e40, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 22:07:30,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. service=AccessControlService 2023-07-22 22:07:30,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:07:30,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 73aeab55b49128ff81f70e16f52e9e40 2023-07-22 22:07:30,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:30,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 73aeab55b49128ff81f70e16f52e9e40 2023-07-22 22:07:30,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 73aeab55b49128ff81f70e16f52e9e40 2023-07-22 22:07:30,568 INFO [StoreOpener-42e75ca1b66924ec92b92e644142fbcd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 42e75ca1b66924ec92b92e644142fbcd 2023-07-22 22:07:30,575 INFO [StoreOpener-73aeab55b49128ff81f70e16f52e9e40-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 73aeab55b49128ff81f70e16f52e9e40 2023-07-22 22:07:30,576 DEBUG [StoreOpener-42e75ca1b66924ec92b92e644142fbcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/cf 2023-07-22 22:07:30,576 DEBUG [StoreOpener-42e75ca1b66924ec92b92e644142fbcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/cf 2023-07-22 22:07:30,576 DEBUG [StoreOpener-73aeab55b49128ff81f70e16f52e9e40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/cf 2023-07-22 22:07:30,576 DEBUG [StoreOpener-73aeab55b49128ff81f70e16f52e9e40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/cf 2023-07-22 22:07:30,577 INFO [StoreOpener-42e75ca1b66924ec92b92e644142fbcd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42e75ca1b66924ec92b92e644142fbcd columnFamilyName cf 2023-07-22 22:07:30,577 INFO [StoreOpener-73aeab55b49128ff81f70e16f52e9e40-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73aeab55b49128ff81f70e16f52e9e40 columnFamilyName cf 2023-07-22 22:07:30,578 INFO [StoreOpener-42e75ca1b66924ec92b92e644142fbcd-1] regionserver.HStore(310): Store=42e75ca1b66924ec92b92e644142fbcd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:07:30,578 INFO [StoreOpener-73aeab55b49128ff81f70e16f52e9e40-1] regionserver.HStore(310): Store=73aeab55b49128ff81f70e16f52e9e40/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:07:30,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd 2023-07-22 22:07:30,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd 2023-07-22 22:07:30,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40 2023-07-22 22:07:30,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40 2023-07-22 22:07:30,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 22:07:30,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 42e75ca1b66924ec92b92e644142fbcd 2023-07-22 22:07:30,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 73aeab55b49128ff81f70e16f52e9e40 2023-07-22 22:07:30,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:07:30,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 42e75ca1b66924ec92b92e644142fbcd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64662917, jitterRate=-0.03644745051860809}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:07:30,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 42e75ca1b66924ec92b92e644142fbcd: 2023-07-22 22:07:30,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd., pid=61, masterSystemTime=1690063650545 2023-07-22 22:07:30,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:07:30,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:30,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:30,595 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=42e75ca1b66924ec92b92e644142fbcd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:30,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 73aeab55b49128ff81f70e16f52e9e40; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60625925, jitterRate=-0.09660331904888153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:07:30,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 73aeab55b49128ff81f70e16f52e9e40: 2023-07-22 22:07:30,596 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063650595"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063650595"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063650595"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063650595"}]},"ts":"1690063650595"} 2023-07-22 22:07:30,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40., pid=60, masterSystemTime=1690063650545 2023-07-22 22:07:30,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. 2023-07-22 22:07:30,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. 2023-07-22 22:07:30,599 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=73aeab55b49128ff81f70e16f52e9e40, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:30,599 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063650599"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063650599"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063650599"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063650599"}]},"ts":"1690063650599"} 2023-07-22 22:07:30,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-22 22:07:30,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 42e75ca1b66924ec92b92e644142fbcd, server=jenkins-hbase4.apache.org,34749,1690063572232 in 216 msec 2023-07-22 22:07:30,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-22 22:07:30,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 73aeab55b49128ff81f70e16f52e9e40, server=jenkins-hbase4.apache.org,38207,1690063572104 in 218 msec 2023-07-22 22:07:30,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=42e75ca1b66924ec92b92e644142fbcd, ASSIGN in 383 msec 2023-07-22 22:07:30,612 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-22 22:07:30,612 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73aeab55b49128ff81f70e16f52e9e40, ASSIGN in 384 msec 2023-07-22 22:07:30,613 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:07:30,613 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063650613"}]},"ts":"1690063650613"} 2023-07-22 22:07:30,615 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-22 22:07:30,619 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:07:30,619 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-22 22:07:30,621 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36573] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 22:07:30,623 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:30,623 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:30,623 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:30,623 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:30,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:30,625 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:30,625 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:30,625 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:30,627 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 657 msec 2023-07-22 22:07:31,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 22:07:31,089 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-22 22:07:31,089 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-22 22:07:31,089 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:07:31,094 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-22 22:07:31,094 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:07:31,094 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-22 22:07:31,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 22:07:31,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063651102 (current time:1690063651102). 2023-07-22 22:07:31,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:07:31,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x1beac42e to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:31,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@904ae10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:31,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:31,133 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:31,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1beac42e to 127.0.0.1:64066 2023-07-22 22:07:31,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:31,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x25908025 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:31,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6896eb0d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:31,155 DEBUG [hconnection-0x44cebc21-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:31,158 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33342, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:31,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:31,169 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:31,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25908025 to 127.0.0.1:64066 2023-07-22 22:07:31,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:31,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 22:07:31,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:07:31,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 22:07:31,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 22:07:31,179 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 22:07:31,182 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690064251182 2023-07-22 22:07:31,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 22:07:31,182 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,183 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:07:31,184 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:07:31,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 22:07:31,192 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 22:07:31,194 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 15 msec 2023-07-22 22:07:31,195 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 22:07:31,196 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690064251196 2023-07-22 22:07:31,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,237 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-22 22:07:31,237 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:31,238 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-22 22:07:31,238 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-22 22:07:31,239 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,239 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,255 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:31,255 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:31,255 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:31,255 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:31,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:31,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:31,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:31,255 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:31,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:31,255 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,256 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,256 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:07:31,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 22:07:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 22:07:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 22:07:31,257 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 22:07:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,257 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 22:07:31,257 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 22:07:31,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 22:07:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 22:07:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:31,258 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 22:07:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 22:07:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 22:07:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 22:07:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 22:07:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 22:07:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 22:07:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:31,261 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 22:07:31,261 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 22:07:31,261 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 22:07:31,278 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,278 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:31,284 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:31,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 22:07:31,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:31,285 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:07:31,301 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,301 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,301 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:31,301 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,302 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:31,302 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,302 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:31,303 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,303 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:31,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:31,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:31,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:31,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 22:07:31,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b104cd1[Count = 1] remaining members to acquire global barrier 2023-07-22 22:07:31,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:31,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:31,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:31,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:31,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:31,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:31,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 22:07:31,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b104cd1[Count = 0] remaining members to acquire global barrier 2023-07-22 22:07:31,308 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-22 22:07:31,309 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,339 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,341 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,339 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,342 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,342 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 22:07:31,342 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 22:07:31,342 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36573,1690063572179' in zk 2023-07-22 22:07:31,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,342 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,342 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:07:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,342 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 22:07:31,342 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 22:07:31,343 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:31,343 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:31,343 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:31,343 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. started... 2023-07-22 22:07:31,346 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:31,346 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:31,346 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. 2023-07-22 22:07:31,347 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. started... 2023-07-22 22:07:31,351 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42e75ca1b66924ec92b92e644142fbcd: 2023-07-22 22:07:31,352 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,352 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:31,352 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:07:31,353 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73aeab55b49128ff81f70e16f52e9e40: 2023-07-22 22:07:31,353 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,353 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:31,353 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:07:31,390 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 22:07:31,390 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:31,390 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 22:07:31,464 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. completed. 2023-07-22 22:07:31,464 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. 2023-07-22 22:07:31,464 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:31,464 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:31,464 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,464 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 22:07:31,464 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38207,1690063572104' in zk 2023-07-22 22:07:31,485 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:31,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 22:07:31,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:31,487 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 22:07:31,501 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,501 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 22:07:31,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:31,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:31,501 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:31,501 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 22:07:31,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:31,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:31,505 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. completed. 2023-07-22 22:07:31,505 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:31,505 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:31,505 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:31,505 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,505 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 22:07:31,505 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34749,1690063572232' in zk 2023-07-22 22:07:31,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,540 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,540 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 22:07:31,540 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:31,540 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 22:07:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38207,1690063572104': 2023-07-22 22:07:31,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-22 22:07:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:31,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:31,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:31,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:31,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:31,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34749,1690063572232': 2023-07-22 22:07:31,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-22 22:07:31,548 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-22 22:07:31,548 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:07:31,548 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:07:31,548 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,548 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:07:31,570 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,570 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:31,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:31,570 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,570 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,570 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:31,571 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:31,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:31,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,570 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:31,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,571 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:31,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:31,571 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:31,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:31,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:31,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:31,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:31,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,572 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:31,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:31,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:31,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,574 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,574 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,574 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:31,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:31,593 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:31,593 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:31,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:31,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:31,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:31,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:31,594 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:31,595 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,595 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,595 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,595 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,595 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:31,595 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,595 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:31,595 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,595 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:31,595 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:31,604 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,604 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,605 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:31,605 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:31,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:31,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:31,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:31,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:31,611 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:31,612 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:31,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:31,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:31,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:31,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:31,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,787 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:31,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 22:07:31,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:31,788 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 22:07:31,838 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-22 22:07:31,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,840 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:31,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690063651182Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690063651595 (+413 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690063651595Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690063651616 (+21 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690063651661 (+45 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690063651838 (+177 ms) 2023-07-22 22:07:31,842 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 22:07:31,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 659 msec 2023-07-22 22:07:32,288 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:32,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 22:07:32,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:07:32,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38207] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:07:32,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:07:32,304 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,304 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:32,306 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:07:32,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 22:07:32,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063652325 (current time:1690063652325). 2023-07-22 22:07:32,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:07:32,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x623f1ada to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:32,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48cd4588, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:32,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:32,350 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:32,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x623f1ada to 127.0.0.1:64066 2023-07-22 22:07:32,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:32,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x1d69a9cc to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:32,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71a9971, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:32,379 DEBUG [hconnection-0x25597d1f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:32,384 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:32,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:32,399 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:32,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d69a9cc to 127.0.0.1:64066 2023-07-22 22:07:32,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:32,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 22:07:32,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:07:32,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 22:07:32,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 22:07:32,406 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 22:07:32,407 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690064252407 2023-07-22 22:07:32,407 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 22:07:32,409 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:07:32,409 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:07:32,410 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 22:07:32,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 22:07:32,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-22 22:07:32,412 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 22:07:32,413 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690064252413 2023-07-22 22:07:32,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,444 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-22 22:07:32,444 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:32,446 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-22 22:07:32,446 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-22 22:07:32,446 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,447 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,449 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:32,449 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:32,449 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,449 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:32,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:32,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:32,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,450 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,450 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,450 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,450 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:07:32,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 22:07:32,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 22:07:32,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 22:07:32,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,459 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 22:07:32,459 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 22:07:32,459 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 22:07:32,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,463 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 22:07:32,463 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:32,464 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 22:07:32,464 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 22:07:32,464 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 22:07:32,469 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,469 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,469 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:32,470 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,471 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 22:07:32,471 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:32,474 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,476 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 22:07:32,477 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 22:07:32,477 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 22:07:32,477 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 22:07:32,477 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:32,478 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 22:07:32,479 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 22:07:32,479 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 22:07:32,480 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,480 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,480 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:32,480 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:32,481 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,481 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:32,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:32,481 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,481 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:32,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:32,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:32,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:32,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 22:07:32,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6842fbfd[Count = 1] remaining members to acquire global barrier 2023-07-22 22:07:32,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:32,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:32,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:32,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:32,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:32,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:32,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 22:07:32,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6842fbfd[Count = 0] remaining members to acquire global barrier 2023-07-22 22:07:32,485 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-22 22:07:32,486 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,487 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,487 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,487 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,487 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 22:07:32,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,487 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,487 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 22:07:32,487 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 22:07:32,488 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 22:07:32,488 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36573,1690063572179' in zk 2023-07-22 22:07:32,488 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,488 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:07:32,489 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 22:07:32,489 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:32,489 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 22:07:32,490 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:32,492 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:32,492 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:32,492 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:32,492 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. 2023-07-22 22:07:32,492 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. started... 2023-07-22 22:07:32,492 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. started... 2023-07-22 22:07:32,492 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:32,493 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 42e75ca1b66924ec92b92e644142fbcd 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-22 22:07:32,493 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 73aeab55b49128ff81f70e16f52e9e40 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-22 22:07:32,509 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:32,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 22:07:32,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:32,511 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:07:32,521 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/.tmp/cf/7c32646996de458884065a9ffae17cbf 2023-07-22 22:07:32,521 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/.tmp/cf/e4ba86502564432fb6163a07a8561c44 2023-07-22 22:07:32,527 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/.tmp/cf/7c32646996de458884065a9ffae17cbf as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/cf/7c32646996de458884065a9ffae17cbf 2023-07-22 22:07:32,528 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/.tmp/cf/e4ba86502564432fb6163a07a8561c44 as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/cf/e4ba86502564432fb6163a07a8561c44 2023-07-22 22:07:32,533 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/cf/7c32646996de458884065a9ffae17cbf, entries=44, sequenceid=6, filesize=7.8 K 2023-07-22 22:07:32,533 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/cf/e4ba86502564432fb6163a07a8561c44, entries=6, sequenceid=6, filesize=5.2 K 2023-07-22 22:07:32,537 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 42e75ca1b66924ec92b92e644142fbcd in 45ms, sequenceid=6, compaction requested=false 2023-07-22 22:07:32,537 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 73aeab55b49128ff81f70e16f52e9e40 in 45ms, sequenceid=6, compaction requested=false 2023-07-22 22:07:32,537 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-22 22:07:32,538 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-22 22:07:32,541 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42e75ca1b66924ec92b92e644142fbcd: 2023-07-22 22:07:32,541 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73aeab55b49128ff81f70e16f52e9e40: 2023-07-22 22:07:32,541 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,541 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,541 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:32,541 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:32,541 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/cf/e4ba86502564432fb6163a07a8561c44] hfiles 2023-07-22 22:07:32,541 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/cf/e4ba86502564432fb6163a07a8561c44 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,541 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/cf/7c32646996de458884065a9ffae17cbf] hfiles 2023-07-22 22:07:32,541 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/cf/7c32646996de458884065a9ffae17cbf for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,583 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. completed. 2023-07-22 22:07:32,583 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:32,583 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:32,583 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:32,583 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,583 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 22:07:32,583 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34749,1690063572232' in zk 2023-07-22 22:07:32,586 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 22:07:32,586 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,586 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:32,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:32,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:32,586 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 22:07:32,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:32,589 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. completed. 2023-07-22 22:07:32,589 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. 2023-07-22 22:07:32,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:32,589 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:32,589 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:32,589 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,589 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 22:07:32,589 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38207,1690063572104' in zk 2023-07-22 22:07:32,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,591 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 22:07:32,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,591 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,591 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:32,591 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 22:07:32,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:32,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:32,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:32,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34749,1690063572232': 2023-07-22 22:07:32,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-22 22:07:32,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:32,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:32,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:32,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:32,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:32,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38207,1690063572104': 2023-07-22 22:07:32,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-22 22:07:32,604 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-22 22:07:32,604 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:07:32,604 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:07:32,604 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,604 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:07:32,610 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,610 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,610 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,610 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:32,610 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:32,610 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:32,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:32,611 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,611 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,613 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:32,613 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:32,614 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:32,618 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:32,618 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,618 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:32,618 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,618 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:32,618 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:32,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:32,618 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:32,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,618 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:32,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:32,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:32,620 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,620 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:32,620 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:32,618 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:32,618 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:32,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:32,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:32,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:32,620 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,620 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:32,620 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,620 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,620 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,621 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,621 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-22 22:07:32,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:32,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:32,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:32,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:32,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,662 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-22 22:07:32,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,662 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:32,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690063652407Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690063652618 (+211 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690063652618Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690063652623 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690063652632 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690063652662 (+30 ms) 2023-07-22 22:07:32,665 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 22:07:32,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 257 msec 2023-07-22 22:07:32,711 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:32,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 22:07:32,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:07:32,745 DEBUG [Listener at jenkins-hbase4.apache.org/35991] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 22:07:32,748 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 22:07:32,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 22:07:32,750 DEBUG [Listener at jenkins-hbase4.apache.org/35991] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 22:07:32,753 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 22:07:32,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36573] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 22:07:32,753 DEBUG [Listener at jenkins-hbase4.apache.org/35991] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 22:07:32,756 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 22:07:32,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38207] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 22:07:32,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 22:07:32,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:32,760 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:07:32,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-22 22:07:32,761 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:07:32,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 22:07:32,764 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7 2023-07-22 22:07:32,764 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b 2023-07-22 22:07:32,765 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7 empty. 2023-07-22 22:07:32,765 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b empty. 2023-07-22 22:07:32,765 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7 2023-07-22 22:07:32,765 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b 2023-07-22 22:07:32,765 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-22 22:07:32,774 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-22 22:07:32,775 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => c0909f7d7528afed72d9834da56f45d7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:07:32,776 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => c1cca748fc101e5a25326c395ff0b91b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:07:32,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:32,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:32,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing c1cca748fc101e5a25326c395ff0b91b, disabling compactions & flushes 2023-07-22 22:07:32,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing c0909f7d7528afed72d9834da56f45d7, disabling compactions & flushes 2023-07-22 22:07:32,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b. 2023-07-22 22:07:32,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7. 2023-07-22 22:07:32,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7. 2023-07-22 22:07:32,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b. 2023-07-22 22:07:32,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7. after waiting 0 ms 2023-07-22 22:07:32,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b. after waiting 0 ms 2023-07-22 22:07:32,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b. 2023-07-22 22:07:32,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7. 2023-07-22 22:07:32,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b. 2023-07-22 22:07:32,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7. 2023-07-22 22:07:32,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for c1cca748fc101e5a25326c395ff0b91b: 2023-07-22 22:07:32,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for c0909f7d7528afed72d9834da56f45d7: 2023-07-22 22:07:32,786 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:07:32,787 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063652787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063652787"}]},"ts":"1690063652787"} 2023-07-22 22:07:32,787 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063652787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063652787"}]},"ts":"1690063652787"} 2023-07-22 22:07:32,789 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 22:07:32,790 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:07:32,790 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063652790"}]},"ts":"1690063652790"} 2023-07-22 22:07:32,791 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-22 22:07:32,794 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:07:32,795 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:07:32,795 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:07:32,795 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:07:32,795 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:07:32,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c0909f7d7528afed72d9834da56f45d7, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c1cca748fc101e5a25326c395ff0b91b, ASSIGN}] 2023-07-22 22:07:32,798 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c1cca748fc101e5a25326c395ff0b91b, ASSIGN 2023-07-22 22:07:32,798 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c0909f7d7528afed72d9834da56f45d7, ASSIGN 2023-07-22 22:07:32,799 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c1cca748fc101e5a25326c395ff0b91b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38207,1690063572104; forceNewPlan=false, retain=false 2023-07-22 22:07:32,799 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c0909f7d7528afed72d9834da56f45d7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34749,1690063572232; forceNewPlan=false, retain=false 2023-07-22 22:07:32,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 22:07:32,949 INFO [jenkins-hbase4:33185] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 22:07:32,952 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c0909f7d7528afed72d9834da56f45d7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:32,952 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=c1cca748fc101e5a25326c395ff0b91b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:32,952 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063652952"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063652952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063652952"}]},"ts":"1690063652952"} 2023-07-22 22:07:32,952 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063652952"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063652952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063652952"}]},"ts":"1690063652952"} 2023-07-22 22:07:32,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure c1cca748fc101e5a25326c395ff0b91b, server=jenkins-hbase4.apache.org,38207,1690063572104}] 2023-07-22 22:07:32,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure c0909f7d7528afed72d9834da56f45d7, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:07:33,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 22:07:33,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b. 2023-07-22 22:07:33,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7. 2023-07-22 22:07:33,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c1cca748fc101e5a25326c395ff0b91b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b.', STARTKEY => '2', ENDKEY => ''} 2023-07-22 22:07:33,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c0909f7d7528afed72d9834da56f45d7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7.', STARTKEY => '', ENDKEY => '2'} 2023-07-22 22:07:33,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b. service=AccessControlService 2023-07-22 22:07:33,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7. service=AccessControlService 2023-07-22 22:07:33,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:07:33,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:07:33,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c1cca748fc101e5a25326c395ff0b91b 2023-07-22 22:07:33,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c0909f7d7528afed72d9834da56f45d7 2023-07-22 22:07:33,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:33,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:33,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c1cca748fc101e5a25326c395ff0b91b 2023-07-22 22:07:33,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c0909f7d7528afed72d9834da56f45d7 2023-07-22 22:07:33,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c1cca748fc101e5a25326c395ff0b91b 2023-07-22 22:07:33,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c0909f7d7528afed72d9834da56f45d7 2023-07-22 22:07:33,113 INFO [StoreOpener-c1cca748fc101e5a25326c395ff0b91b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c1cca748fc101e5a25326c395ff0b91b 2023-07-22 22:07:33,113 INFO [StoreOpener-c0909f7d7528afed72d9834da56f45d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c0909f7d7528afed72d9834da56f45d7 2023-07-22 22:07:33,114 DEBUG [StoreOpener-c0909f7d7528afed72d9834da56f45d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/cf 2023-07-22 22:07:33,114 DEBUG [StoreOpener-c0909f7d7528afed72d9834da56f45d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/cf 2023-07-22 22:07:33,114 DEBUG [StoreOpener-c1cca748fc101e5a25326c395ff0b91b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/cf 2023-07-22 22:07:33,114 DEBUG [StoreOpener-c1cca748fc101e5a25326c395ff0b91b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/cf 2023-07-22 22:07:33,115 INFO [StoreOpener-c0909f7d7528afed72d9834da56f45d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0909f7d7528afed72d9834da56f45d7 columnFamilyName cf 2023-07-22 22:07:33,115 INFO [StoreOpener-c1cca748fc101e5a25326c395ff0b91b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c1cca748fc101e5a25326c395ff0b91b columnFamilyName cf 2023-07-22 22:07:33,115 INFO [StoreOpener-c0909f7d7528afed72d9834da56f45d7-1] regionserver.HStore(310): Store=c0909f7d7528afed72d9834da56f45d7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:07:33,115 INFO [StoreOpener-c1cca748fc101e5a25326c395ff0b91b-1] regionserver.HStore(310): Store=c1cca748fc101e5a25326c395ff0b91b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:07:33,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b 2023-07-22 22:07:33,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7 2023-07-22 22:07:33,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b 2023-07-22 22:07:33,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7 2023-07-22 22:07:33,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c1cca748fc101e5a25326c395ff0b91b 2023-07-22 22:07:33,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c0909f7d7528afed72d9834da56f45d7 2023-07-22 22:07:33,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:07:33,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:07:33,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c1cca748fc101e5a25326c395ff0b91b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70897234, jitterRate=0.056451112031936646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:07:33,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c0909f7d7528afed72d9834da56f45d7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62017766, jitterRate=-0.07586327195167542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:07:33,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c1cca748fc101e5a25326c395ff0b91b: 2023-07-22 22:07:33,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c0909f7d7528afed72d9834da56f45d7: 2023-07-22 22:07:33,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b., pid=69, masterSystemTime=1690063653107 2023-07-22 22:07:33,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7., pid=70, masterSystemTime=1690063653107 2023-07-22 22:07:33,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7. 2023-07-22 22:07:33,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7. 2023-07-22 22:07:33,125 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c0909f7d7528afed72d9834da56f45d7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:33,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b. 2023-07-22 22:07:33,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b. 2023-07-22 22:07:33,125 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063653125"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063653125"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063653125"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063653125"}]},"ts":"1690063653125"} 2023-07-22 22:07:33,129 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=c1cca748fc101e5a25326c395ff0b91b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:33,129 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063653129"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063653129"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063653129"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063653129"}]},"ts":"1690063653129"} 2023-07-22 22:07:33,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-22 22:07:33,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure c0909f7d7528afed72d9834da56f45d7, server=jenkins-hbase4.apache.org,34749,1690063572232 in 172 msec 2023-07-22 22:07:33,132 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c0909f7d7528afed72d9834da56f45d7, ASSIGN in 336 msec 2023-07-22 22:07:33,135 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-22 22:07:33,135 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure c1cca748fc101e5a25326c395ff0b91b, server=jenkins-hbase4.apache.org,38207,1690063572104 in 176 msec 2023-07-22 22:07:33,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-22 22:07:33,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c1cca748fc101e5a25326c395ff0b91b, ASSIGN in 340 msec 2023-07-22 22:07:33,142 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:07:33,143 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063653143"}]},"ts":"1690063653143"} 2023-07-22 22:07:33,144 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-22 22:07:33,147 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:07:33,147 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-22 22:07:33,152 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36573] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-22 22:07:33,154 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:33,154 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:33,154 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:33,154 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:33,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:33,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:33,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:33,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:33,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:33,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:33,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:33,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:33,158 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-22 22:07:33,163 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 398 msec 2023-07-22 22:07:33,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 22:07:33,366 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-22 22:07:33,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions c0909f7d7528afed72d9834da56f45d7, c1cca748fc101e5a25326c395ff0b91b 2023-07-22 22:07:33,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c0909f7d7528afed72d9834da56f45d7, c1cca748fc101e5a25326c395ff0b91b], force=true 2023-07-22 22:07:33,398 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c0909f7d7528afed72d9834da56f45d7, c1cca748fc101e5a25326c395ff0b91b], force=true 2023-07-22 22:07:33,398 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c0909f7d7528afed72d9834da56f45d7, c1cca748fc101e5a25326c395ff0b91b], force=true 2023-07-22 22:07:33,398 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c0909f7d7528afed72d9834da56f45d7, c1cca748fc101e5a25326c395ff0b91b], force=true 2023-07-22 22:07:33,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 22:07:33,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c0909f7d7528afed72d9834da56f45d7, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c1cca748fc101e5a25326c395ff0b91b, UNASSIGN}] 2023-07-22 22:07:33,426 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c0909f7d7528afed72d9834da56f45d7, UNASSIGN 2023-07-22 22:07:33,426 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c1cca748fc101e5a25326c395ff0b91b, UNASSIGN 2023-07-22 22:07:33,427 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c0909f7d7528afed72d9834da56f45d7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:33,427 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=c1cca748fc101e5a25326c395ff0b91b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:33,427 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063653426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063653426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063653426"}]},"ts":"1690063653426"} 2023-07-22 22:07:33,427 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063653426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063653426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063653426"}]},"ts":"1690063653426"} 2023-07-22 22:07:33,428 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure c1cca748fc101e5a25326c395ff0b91b, server=jenkins-hbase4.apache.org,38207,1690063572104}] 2023-07-22 22:07:33,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure c0909f7d7528afed72d9834da56f45d7, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:07:33,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 22:07:33,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c1cca748fc101e5a25326c395ff0b91b 2023-07-22 22:07:33,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c0909f7d7528afed72d9834da56f45d7 2023-07-22 22:07:33,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c1cca748fc101e5a25326c395ff0b91b, disabling compactions & flushes 2023-07-22 22:07:33,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c0909f7d7528afed72d9834da56f45d7, disabling compactions & flushes 2023-07-22 22:07:33,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b. 2023-07-22 22:07:33,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7. 2023-07-22 22:07:33,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b. 2023-07-22 22:07:33,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7. 2023-07-22 22:07:33,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b. after waiting 0 ms 2023-07-22 22:07:33,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7. after waiting 0 ms 2023-07-22 22:07:33,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b. 2023-07-22 22:07:33,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7. 2023-07-22 22:07:33,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c1cca748fc101e5a25326c395ff0b91b 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-22 22:07:33,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c0909f7d7528afed72d9834da56f45d7 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-22 22:07:33,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/.tmp/cf/e7865a3a8c8749719da30c7518d9a1ee 2023-07-22 22:07:33,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/.tmp/cf/f1e01f27ef5541f69d6e77ce4e73c862 2023-07-22 22:07:33,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/.tmp/cf/f1e01f27ef5541f69d6e77ce4e73c862 as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/cf/f1e01f27ef5541f69d6e77ce4e73c862 2023-07-22 22:07:33,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/cf/f1e01f27ef5541f69d6e77ce4e73c862, entries=1, sequenceid=5, filesize=4.7 K 2023-07-22 22:07:33,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for c0909f7d7528afed72d9834da56f45d7 in 39ms, sequenceid=5, compaction requested=false 2023-07-22 22:07:33,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/.tmp/cf/e7865a3a8c8749719da30c7518d9a1ee as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/cf/e7865a3a8c8749719da30c7518d9a1ee 2023-07-22 22:07:33,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/cf/e7865a3a8c8749719da30c7518d9a1ee, entries=1, sequenceid=5, filesize=4.7 K 2023-07-22 22:07:33,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for c1cca748fc101e5a25326c395ff0b91b in 54ms, sequenceid=5, compaction requested=false 2023-07-22 22:07:33,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-22 22:07:33,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-22 22:07:33,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:07:33,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:07:33,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7. 2023-07-22 22:07:33,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b. 2023-07-22 22:07:33,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c1cca748fc101e5a25326c395ff0b91b: 2023-07-22 22:07:33,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c0909f7d7528afed72d9834da56f45d7: 2023-07-22 22:07:33,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c1cca748fc101e5a25326c395ff0b91b 2023-07-22 22:07:33,661 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=c1cca748fc101e5a25326c395ff0b91b, regionState=CLOSED 2023-07-22 22:07:33,661 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063653661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063653661"}]},"ts":"1690063653661"} 2023-07-22 22:07:33,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c0909f7d7528afed72d9834da56f45d7 2023-07-22 22:07:33,662 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c0909f7d7528afed72d9834da56f45d7, regionState=CLOSED 2023-07-22 22:07:33,662 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690063653662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063653662"}]},"ts":"1690063653662"} 2023-07-22 22:07:33,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-22 22:07:33,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure c1cca748fc101e5a25326c395ff0b91b, server=jenkins-hbase4.apache.org,38207,1690063572104 in 235 msec 2023-07-22 22:07:33,665 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-22 22:07:33,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure c0909f7d7528afed72d9834da56f45d7, server=jenkins-hbase4.apache.org,34749,1690063572232 in 234 msec 2023-07-22 22:07:33,666 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c1cca748fc101e5a25326c395ff0b91b, UNASSIGN in 241 msec 2023-07-22 22:07:33,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-22 22:07:33,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c0909f7d7528afed72d9834da56f45d7, UNASSIGN in 245 msec 2023-07-22 22:07:33,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 22:07:34,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 22:07:34,178 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0004_000001 (auth:SIMPLE) 2023-07-22 22:07:34,228 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-22 22:07:34,231 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652758.c0909f7d7528afed72d9834da56f45d7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:34,231 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690063652758.c1cca748fc101e5a25326c395ff0b91b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:34,231 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:34,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=564a33e16379e082278cf7e88eda0838, ASSIGN}] 2023-07-22 22:07:34,303 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=564a33e16379e082278cf7e88eda0838, ASSIGN 2023-07-22 22:07:34,304 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=564a33e16379e082278cf7e88eda0838, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,34749,1690063572232; forceNewPlan=false, retain=false 2023-07-22 22:07:34,455 INFO [jenkins-hbase4:33185] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 22:07:34,457 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=564a33e16379e082278cf7e88eda0838, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:34,457 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690063654457"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063654457"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063654457"}]},"ts":"1690063654457"} 2023-07-22 22:07:34,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 564a33e16379e082278cf7e88eda0838, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:07:34,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 22:07:34,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838. 2023-07-22 22:07:34,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 564a33e16379e082278cf7e88eda0838, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838.', STARTKEY => '', ENDKEY => ''} 2023-07-22 22:07:34,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838. service=AccessControlService 2023-07-22 22:07:34,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:07:34,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 564a33e16379e082278cf7e88eda0838 2023-07-22 22:07:34,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:34,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 564a33e16379e082278cf7e88eda0838 2023-07-22 22:07:34,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 564a33e16379e082278cf7e88eda0838 2023-07-22 22:07:34,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/.regioninfo 2023-07-22 22:07:34,662 INFO [StoreOpener-564a33e16379e082278cf7e88eda0838-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 564a33e16379e082278cf7e88eda0838 2023-07-22 22:07:34,669 DEBUG [StoreOpener-564a33e16379e082278cf7e88eda0838-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/cf 2023-07-22 22:07:34,669 DEBUG [StoreOpener-564a33e16379e082278cf7e88eda0838-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/cf 2023-07-22 22:07:34,669 INFO [StoreOpener-564a33e16379e082278cf7e88eda0838-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 564a33e16379e082278cf7e88eda0838 columnFamilyName cf 2023-07-22 22:07:34,709 DEBUG [StoreOpener-564a33e16379e082278cf7e88eda0838-1] regionserver.HStore(539): loaded hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/cf/e7865a3a8c8749719da30c7518d9a1ee.c1cca748fc101e5a25326c395ff0b91b->hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/cf/e7865a3a8c8749719da30c7518d9a1ee-top 2023-07-22 22:07:34,718 DEBUG [StoreOpener-564a33e16379e082278cf7e88eda0838-1] regionserver.HStore(539): loaded hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/cf/f1e01f27ef5541f69d6e77ce4e73c862.c0909f7d7528afed72d9834da56f45d7->hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/cf/f1e01f27ef5541f69d6e77ce4e73c862-top 2023-07-22 22:07:34,718 INFO [StoreOpener-564a33e16379e082278cf7e88eda0838-1] regionserver.HStore(310): Store=564a33e16379e082278cf7e88eda0838/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:07:34,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838 2023-07-22 22:07:34,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838 2023-07-22 22:07:34,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 564a33e16379e082278cf7e88eda0838 2023-07-22 22:07:34,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 564a33e16379e082278cf7e88eda0838; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68106819, jitterRate=0.014870688319206238}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:07:34,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 564a33e16379e082278cf7e88eda0838: 2023-07-22 22:07:34,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838., pid=77, masterSystemTime=1690063654610 2023-07-22 22:07:34,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838.,because compaction is disabled. 2023-07-22 22:07:34,729 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=564a33e16379e082278cf7e88eda0838, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:34,729 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690063654729"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063654729"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063654729"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063654729"}]},"ts":"1690063654729"} 2023-07-22 22:07:34,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838. 2023-07-22 22:07:34,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838. 2023-07-22 22:07:34,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-22 22:07:34,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 564a33e16379e082278cf7e88eda0838, server=jenkins-hbase4.apache.org,34749,1690063572232 in 272 msec 2023-07-22 22:07:34,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-22 22:07:34,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=564a33e16379e082278cf7e88eda0838, ASSIGN in 434 msec 2023-07-22 22:07:34,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c0909f7d7528afed72d9834da56f45d7, c1cca748fc101e5a25326c395ff0b91b], force=true in 1.3470 sec 2023-07-22 22:07:35,188 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:07:35,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 22:07:35,508 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-22 22:07:35,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 22:07:35,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063655509 (current time:1690063655509). 2023-07-22 22:07:35,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:07:35,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x068dad3a to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:35,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@241151f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:35,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:35,523 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:35,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x068dad3a to 127.0.0.1:64066 2023-07-22 22:07:35,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:35,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x50fc8b9d to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:35,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b7308c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:35,541 DEBUG [hconnection-0x154378a7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:35,544 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:35,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:35,551 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:35,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50fc8b9d to 127.0.0.1:64066 2023-07-22 22:07:35,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:35,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-22 22:07:35,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:07:35,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 22:07:35,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 22:07:35,556 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 22:07:35,557 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690064255557 2023-07-22 22:07:35,557 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 22:07:35,561 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:07:35,561 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:07:35,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 22:07:35,562 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 22:07:35,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-22 22:07:35,564 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 22:07:35,564 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690064255564 2023-07-22 22:07:35,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,591 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-22 22:07:35,591 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:35,592 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-22 22:07:35,592 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-22 22:07:35,593 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,593 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,594 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:35,594 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:35,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:35,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:35,595 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:35,594 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:35,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:35,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:35,595 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:35,595 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:07:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 22:07:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,597 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 22:07:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 22:07:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,597 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 22:07:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 22:07:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,597 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 22:07:35,598 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,599 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 22:07:35,599 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:35,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,601 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 22:07:35,602 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 22:07:35,602 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:35,602 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:35,604 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 22:07:35,604 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 22:07:35,604 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 22:07:35,604 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 22:07:35,604 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 22:07:35,604 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 22:07:35,605 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 22:07:35,605 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 22:07:35,604 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 22:07:35,606 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,606 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:35,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:35,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:35,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:35,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:35,609 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,609 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,609 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,610 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:35,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:35,610 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,610 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:35,611 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,611 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:35,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:35,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:35,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:35,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:35,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-22 22:07:35,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c3a7502[Count = 0] remaining members to acquire global barrier 2023-07-22 22:07:35,612 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-22 22:07:35,612 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,614 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:35,614 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:07:35,614 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,615 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,615 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 22:07:35,615 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:35,615 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:35,615 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,615 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838. 2023-07-22 22:07:35,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,616 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 22:07:35,616 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 22:07:35,616 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 22:07:35,616 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36573,1690063572179' in zk 2023-07-22 22:07:35,616 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838. started... 2023-07-22 22:07:35,616 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 22:07:35,616 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38207,1690063572104' in zk 2023-07-22 22:07:35,618 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 564a33e16379e082278cf7e88eda0838: 2023-07-22 22:07:35,618 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,618 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:35,618 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/cf/e7865a3a8c8749719da30c7518d9a1ee.c1cca748fc101e5a25326c395ff0b91b->hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/cf/e7865a3a8c8749719da30c7518d9a1ee-top, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/cf/f1e01f27ef5541f69d6e77ce4e73c862.c0909f7d7528afed72d9834da56f45d7->hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/cf/f1e01f27ef5541f69d6e77ce4e73c862-top] hfiles 2023-07-22 22:07:35,618 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/cf/e7865a3a8c8749719da30c7518d9a1ee.c1cca748fc101e5a25326c395ff0b91b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,619 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 22:07:35,619 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:35,619 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/cf/f1e01f27ef5541f69d6e77ce4e73c862.c0909f7d7528afed72d9834da56f45d7 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,621 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 22:07:35,619 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 22:07:35,629 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:35,629 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 22:07:35,660 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838. completed. 2023-07-22 22:07:35,660 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838. 2023-07-22 22:07:35,660 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:35,660 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:35,660 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:35,660 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 22:07:35,660 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34749,1690063572232' in zk 2023-07-22 22:07:35,661 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:35,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-22 22:07:35,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:35,662 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:07:35,672 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 22:07:35,672 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:35,672 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:35,672 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 22:07:35,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:35,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:35,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:35,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:35,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:35,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:35,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:35,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:35,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:35,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,34749,1690063572232': 2023-07-22 22:07:35,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-22 22:07:35,678 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-22 22:07:35,678 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:07:35,678 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:07:35,678 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,678 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:07:35,680 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,680 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:35,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,680 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,680 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:35,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,681 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,681 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:35,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:35,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:35,681 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:35,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,682 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:35,683 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:35,684 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:35,685 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:35,685 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:35,686 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:35,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:35,688 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:35,688 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,688 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:35,688 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:35,688 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,688 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:35,688 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:35,688 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:35,688 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:35,688 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:35,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:35,688 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,688 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:35,689 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:35,689 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,689 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:35,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:35,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,691 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:35,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:35,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:35,691 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:35,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-22 22:07:35,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:35,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:35,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:35,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:35,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:35,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:35,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:35,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:35,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:35,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-22 22:07:35,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,817 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-22 22:07:35,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,821 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690063655557Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690063655689 (+132 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690063655689Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690063655700 (+11 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690063655711 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690063655817 (+106 ms) 2023-07-22 22:07:35,824 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 22:07:35,826 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 264 msec 2023-07-22 22:07:35,863 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:35,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-22 22:07:35,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:07:35,866 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063655866 2023-07-22 22:07:35,866 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37905, tgtDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063655866, rawTgtDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063655866, srcFsUri=hdfs://localhost:37905, srcDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:07:35,893 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37905, inputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:07:35,893 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1685307105_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063655866, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063655866/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,893 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37905, inputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3, snapshotDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-22 22:07:35,917 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063655866/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:35,978 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:35,978 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:35,979 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:35,979 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:35,980 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:35,980 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:35,980 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:36,060 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/hadoop-4425608613376366444.jar 2023-07-22 22:07:36,060 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:36,061 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:36,061 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:36,062 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:36,062 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:36,063 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:36,063 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 22:07:36,064 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 22:07:36,064 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 22:07:36,065 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 22:07:36,065 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 22:07:36,066 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 22:07:36,066 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 22:07:36,067 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 22:07:36,067 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 22:07:36,068 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 22:07:36,068 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:36,069 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:36,069 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:36,069 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:36,069 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:36,070 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:36,070 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:36,609 WARN [DataStreamer for file /user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1690063580416_0005/libjars/hbase-client-2.4.18-SNAPSHOT.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-22 22:07:36,749 WARN [Listener at jenkins-hbase4.apache.org/35991] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 22:07:36,753 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-22 22:07:36,755 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-22 22:07:36,927 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:36,927 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:37,175 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0005_000001 (auth:SIMPLE) 2023-07-22 22:07:40,120 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:07:43,360 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0005_000001 (auth:SIMPLE) 2023-07-22 22:07:45,724 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0005_000001 (auth:SIMPLE) 2023-07-22 22:07:51,093 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 22:07:51,112 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 22:07:51,151 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,151 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 22:07:51,152 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 22:07:51,152 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2071152985_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,153 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-22 22:07:51,153 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-22 22:07:51,153 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2071152985_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063655866/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063655866/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,154 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063655866/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-22 22:07:51,154 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063655866/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-22 22:07:51,164 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 22:07:51,175 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063671175"}]},"ts":"1690063671175"} 2023-07-22 22:07:51,179 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-22 22:07:51,185 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-22 22:07:51,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=564a33e16379e082278cf7e88eda0838, UNASSIGN}] 2023-07-22 22:07:51,187 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=564a33e16379e082278cf7e88eda0838, UNASSIGN 2023-07-22 22:07:51,199 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=564a33e16379e082278cf7e88eda0838, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:51,199 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690063671199"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063671199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063671199"}]},"ts":"1690063671199"} 2023-07-22 22:07:51,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 564a33e16379e082278cf7e88eda0838, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:07:51,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 22:07:51,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 564a33e16379e082278cf7e88eda0838 2023-07-22 22:07:51,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 564a33e16379e082278cf7e88eda0838, disabling compactions & flushes 2023-07-22 22:07:51,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838. 2023-07-22 22:07:51,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838. 2023-07-22 22:07:51,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838. after waiting 0 ms 2023-07-22 22:07:51,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838. 2023-07-22 22:07:51,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-22 22:07:51,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:07:51,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838. 2023-07-22 22:07:51,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 564a33e16379e082278cf7e88eda0838: 2023-07-22 22:07:51,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 564a33e16379e082278cf7e88eda0838 2023-07-22 22:07:51,372 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=564a33e16379e082278cf7e88eda0838, regionState=CLOSED 2023-07-22 22:07:51,372 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690063671372"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063671372"}]},"ts":"1690063671372"} 2023-07-22 22:07:51,375 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-22 22:07:51,375 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 564a33e16379e082278cf7e88eda0838, server=jenkins-hbase4.apache.org,34749,1690063572232 in 170 msec 2023-07-22 22:07:51,377 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-22 22:07:51,377 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=564a33e16379e082278cf7e88eda0838, UNASSIGN in 189 msec 2023-07-22 22:07:51,378 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063671378"}]},"ts":"1690063671378"} 2023-07-22 22:07:51,379 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-22 22:07:51,464 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-22 22:07:51,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 22:07:51,490 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 323 msec 2023-07-22 22:07:51,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 22:07:51,779 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-22 22:07:51,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,784 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,785 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,788 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36573] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,792 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838 2023-07-22 22:07:51,793 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7 2023-07-22 22:07:51,794 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b 2023-07-22 22:07:51,796 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/cf, FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/recovered.edits] 2023-07-22 22:07:51,797 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/cf, FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/recovered.edits] 2023-07-22 22:07:51,798 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/cf, FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/recovered.edits] 2023-07-22 22:07:51,805 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/cf/e7865a3a8c8749719da30c7518d9a1ee.c1cca748fc101e5a25326c395ff0b91b to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/cf/e7865a3a8c8749719da30c7518d9a1ee.c1cca748fc101e5a25326c395ff0b91b 2023-07-22 22:07:51,811 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/cf/f1e01f27ef5541f69d6e77ce4e73c862.c0909f7d7528afed72d9834da56f45d7 to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/cf/f1e01f27ef5541f69d6e77ce4e73c862.c0909f7d7528afed72d9834da56f45d7 2023-07-22 22:07:51,813 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/cf/e7865a3a8c8749719da30c7518d9a1ee to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/cf/e7865a3a8c8749719da30c7518d9a1ee 2023-07-22 22:07:51,822 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/recovered.edits/8.seqid to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b/recovered.edits/8.seqid 2023-07-22 22:07:51,823 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c1cca748fc101e5a25326c395ff0b91b 2023-07-22 22:07:51,883 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/cf/f1e01f27ef5541f69d6e77ce4e73c862 to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/cf/f1e01f27ef5541f69d6e77ce4e73c862 2023-07-22 22:07:51,885 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/recovered.edits/12.seqid to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838/recovered.edits/12.seqid 2023-07-22 22:07:51,886 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/564a33e16379e082278cf7e88eda0838 2023-07-22 22:07:51,887 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,887 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,887 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,888 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 22:07:51,889 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 22:07:51,889 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 22:07:51,891 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/recovered.edits/8.seqid to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7/recovered.edits/8.seqid 2023-07-22 22:07:51,892 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c0909f7d7528afed72d9834da56f45d7 2023-07-22 22:07:51,892 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-22 22:07:51,895 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,898 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-22 22:07:51,903 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,903 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,903 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:51,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-22 22:07:51,903 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:51,903 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,903 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:51,903 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:51,903 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 22:07:51,904 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-22 22:07:51,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-22 22:07:51,907 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:51,908 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:51,908 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:51,908 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:51,909 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,909 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-22 22:07:51,909 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063671909"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:51,912 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-22 22:07:51,912 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 564a33e16379e082278cf7e88eda0838, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690063652759.564a33e16379e082278cf7e88eda0838.', STARTKEY => '', ENDKEY => ''}] 2023-07-22 22:07:51,912 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-22 22:07:51,912 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690063671912"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:51,927 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-22 22:07:51,943 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:51,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 162 msec 2023-07-22 22:07:52,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-22 22:07:52,017 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-22 22:07:52,017 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 22:07:52,024 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063672023"}]},"ts":"1690063672023"} 2023-07-22 22:07:52,027 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-22 22:07:52,030 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-22 22:07:52,031 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=42e75ca1b66924ec92b92e644142fbcd, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73aeab55b49128ff81f70e16f52e9e40, UNASSIGN}] 2023-07-22 22:07:52,033 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=42e75ca1b66924ec92b92e644142fbcd, UNASSIGN 2023-07-22 22:07:52,033 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73aeab55b49128ff81f70e16f52e9e40, UNASSIGN 2023-07-22 22:07:52,034 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=42e75ca1b66924ec92b92e644142fbcd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:52,035 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=73aeab55b49128ff81f70e16f52e9e40, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:52,035 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063672034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063672034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063672034"}]},"ts":"1690063672034"} 2023-07-22 22:07:52,035 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063672034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063672034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063672034"}]},"ts":"1690063672034"} 2023-07-22 22:07:52,037 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 42e75ca1b66924ec92b92e644142fbcd, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:07:52,039 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 73aeab55b49128ff81f70e16f52e9e40, server=jenkins-hbase4.apache.org,38207,1690063572104}] 2023-07-22 22:07:52,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 22:07:52,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 42e75ca1b66924ec92b92e644142fbcd 2023-07-22 22:07:52,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 42e75ca1b66924ec92b92e644142fbcd, disabling compactions & flushes 2023-07-22 22:07:52,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:52,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:52,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. after waiting 0 ms 2023-07-22 22:07:52,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:52,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 73aeab55b49128ff81f70e16f52e9e40 2023-07-22 22:07:52,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 73aeab55b49128ff81f70e16f52e9e40, disabling compactions & flushes 2023-07-22 22:07:52,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. 2023-07-22 22:07:52,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. 2023-07-22 22:07:52,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. after waiting 0 ms 2023-07-22 22:07:52,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. 2023-07-22 22:07:52,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:07:52,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:07:52,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40. 2023-07-22 22:07:52,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 73aeab55b49128ff81f70e16f52e9e40: 2023-07-22 22:07:52,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 73aeab55b49128ff81f70e16f52e9e40 2023-07-22 22:07:52,205 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=73aeab55b49128ff81f70e16f52e9e40, regionState=CLOSED 2023-07-22 22:07:52,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:07:52,205 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063672205"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063672205"}]},"ts":"1690063672205"} 2023-07-22 22:07:52,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:07:52,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd. 2023-07-22 22:07:52,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 42e75ca1b66924ec92b92e644142fbcd: 2023-07-22 22:07:52,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 42e75ca1b66924ec92b92e644142fbcd 2023-07-22 22:07:52,208 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=42e75ca1b66924ec92b92e644142fbcd, regionState=CLOSED 2023-07-22 22:07:52,208 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690063672208"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063672208"}]},"ts":"1690063672208"} 2023-07-22 22:07:52,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-22 22:07:52,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 73aeab55b49128ff81f70e16f52e9e40, server=jenkins-hbase4.apache.org,38207,1690063572104 in 175 msec 2023-07-22 22:07:52,216 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-22 22:07:52,216 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 42e75ca1b66924ec92b92e644142fbcd, server=jenkins-hbase4.apache.org,34749,1690063572232 in 178 msec 2023-07-22 22:07:52,217 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73aeab55b49128ff81f70e16f52e9e40, UNASSIGN in 185 msec 2023-07-22 22:07:52,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-22 22:07:52,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=42e75ca1b66924ec92b92e644142fbcd, UNASSIGN in 185 msec 2023-07-22 22:07:52,218 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063672218"}]},"ts":"1690063672218"} 2023-07-22 22:07:52,220 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-22 22:07:52,221 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-22 22:07:52,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 204 msec 2023-07-22 22:07:52,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 22:07:52,327 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-22 22:07:52,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,335 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,336 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,337 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36573] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,341 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd 2023-07-22 22:07:52,341 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40 2023-07-22 22:07:52,341 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,341 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,341 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,341 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 22:07:52,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 22:07:52,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 22:07:52,345 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/cf, FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/recovered.edits] 2023-07-22 22:07:52,345 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/cf, FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/recovered.edits] 2023-07-22 22:07:52,346 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 22:07:52,347 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,347 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,347 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:52,347 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,347 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,347 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:52,347 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:52,347 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:52,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-22 22:07:52,351 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/cf/e4ba86502564432fb6163a07a8561c44 to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/cf/e4ba86502564432fb6163a07a8561c44 2023-07-22 22:07:52,351 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/cf/7c32646996de458884065a9ffae17cbf to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/cf/7c32646996de458884065a9ffae17cbf 2023-07-22 22:07:52,355 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/recovered.edits/9.seqid to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd/recovered.edits/9.seqid 2023-07-22 22:07:52,355 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/recovered.edits/9.seqid to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40/recovered.edits/9.seqid 2023-07-22 22:07:52,356 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/42e75ca1b66924ec92b92e644142fbcd 2023-07-22 22:07:52,356 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73aeab55b49128ff81f70e16f52e9e40 2023-07-22 22:07:52,356 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-22 22:07:52,359 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,361 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-22 22:07:52,364 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-22 22:07:52,365 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,365 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-22 22:07:52,365 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063672365"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:52,366 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063672365"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:52,367 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 22:07:52,367 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 42e75ca1b66924ec92b92e644142fbcd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690063649968.42e75ca1b66924ec92b92e644142fbcd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 73aeab55b49128ff81f70e16f52e9e40, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690063649968.73aeab55b49128ff81f70e16f52e9e40.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 22:07:52,367 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-22 22:07:52,367 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690063672367"}]},"ts":"9223372036854775807"} 2023-07-22 22:07:52,369 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-22 22:07:52,371 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 43 msec 2023-07-22 22:07:52,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-22 22:07:52,451 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-22 22:07:52,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-22 22:07:52,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-22 22:07:52,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 22:07:52,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-22 22:07:52,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 22:07:52,505 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 748) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2130395352_1 at /127.0.0.1:45264 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:36487 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2071152985_17 at /127.0.0.1:37856 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2071152985_17 at /127.0.0.1:34506 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2071152985_17 at /127.0.0.1:56966 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2130395352_1 at /127.0.0.1:47990 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3940 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=629 (was 430) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 184), AvailableMemoryMB=5942 (was 6275) 2023-07-22 22:07:52,506 WARN [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-22 22:07:52,534 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=629, ProcessCount=180, AvailableMemoryMB=5938 2023-07-22 22:07:52,535 WARN [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-22 22:07:52,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 22:07:52,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:07:52,540 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:07:52,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-22 22:07:52,541 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:07:52,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 22:07:52,544 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e 2023-07-22 22:07:52,544 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f 2023-07-22 22:07:52,544 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e empty. 2023-07-22 22:07:52,544 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f empty. 2023-07-22 22:07:52,545 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e 2023-07-22 22:07:52,545 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f 2023-07-22 22:07:52,545 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-22 22:07:52,567 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-22 22:07:52,569 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1ec28216a21111f0cdaaac4c6b3ede6f, NAME => 'testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:07:52,569 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 551e1d69b80e5aaa7cfcfd01fc83603e, NAME => 'testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:07:52,603 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:52,603 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 1ec28216a21111f0cdaaac4c6b3ede6f, disabling compactions & flushes 2023-07-22 22:07:52,603 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. 2023-07-22 22:07:52,603 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. 2023-07-22 22:07:52,603 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. after waiting 0 ms 2023-07-22 22:07:52,603 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. 2023-07-22 22:07:52,603 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. 2023-07-22 22:07:52,603 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 1ec28216a21111f0cdaaac4c6b3ede6f: 2023-07-22 22:07:52,614 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:52,614 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 551e1d69b80e5aaa7cfcfd01fc83603e, disabling compactions & flushes 2023-07-22 22:07:52,614 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:07:52,614 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:07:52,614 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. after waiting 0 ms 2023-07-22 22:07:52,614 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:07:52,614 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:07:52,614 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 551e1d69b80e5aaa7cfcfd01fc83603e: 2023-07-22 22:07:52,617 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:07:52,618 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063672618"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063672618"}]},"ts":"1690063672618"} 2023-07-22 22:07:52,618 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063672618"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063672618"}]},"ts":"1690063672618"} 2023-07-22 22:07:52,624 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 22:07:52,627 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:07:52,627 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063672627"}]},"ts":"1690063672627"} 2023-07-22 22:07:52,629 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-22 22:07:52,632 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:07:52,634 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:07:52,634 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:07:52,634 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:07:52,634 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:07:52,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=551e1d69b80e5aaa7cfcfd01fc83603e, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ec28216a21111f0cdaaac4c6b3ede6f, ASSIGN}] 2023-07-22 22:07:52,638 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ec28216a21111f0cdaaac4c6b3ede6f, ASSIGN 2023-07-22 22:07:52,638 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=551e1d69b80e5aaa7cfcfd01fc83603e, ASSIGN 2023-07-22 22:07:52,639 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ec28216a21111f0cdaaac4c6b3ede6f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34749,1690063572232; forceNewPlan=false, retain=false 2023-07-22 22:07:52,639 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=551e1d69b80e5aaa7cfcfd01fc83603e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36573,1690063572179; forceNewPlan=false, retain=false 2023-07-22 22:07:52,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 22:07:52,789 INFO [jenkins-hbase4:33185] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 22:07:52,792 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=551e1d69b80e5aaa7cfcfd01fc83603e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:52,792 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=1ec28216a21111f0cdaaac4c6b3ede6f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:52,792 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063672792"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063672792"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063672792"}]},"ts":"1690063672792"} 2023-07-22 22:07:52,792 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063672792"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063672792"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063672792"}]},"ts":"1690063672792"} 2023-07-22 22:07:52,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 1ec28216a21111f0cdaaac4c6b3ede6f, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:07:52,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 551e1d69b80e5aaa7cfcfd01fc83603e, server=jenkins-hbase4.apache.org,36573,1690063572179}] 2023-07-22 22:07:52,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 22:07:52,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. 2023-07-22 22:07:52,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:07:52,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ec28216a21111f0cdaaac4c6b3ede6f, NAME => 'testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 22:07:52,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 551e1d69b80e5aaa7cfcfd01fc83603e, NAME => 'testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 22:07:52,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. service=AccessControlService 2023-07-22 22:07:52,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. service=AccessControlService 2023-07-22 22:07:52,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:07:52,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 551e1d69b80e5aaa7cfcfd01fc83603e 2023-07-22 22:07:52,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:07:52,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:52,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 551e1d69b80e5aaa7cfcfd01fc83603e 2023-07-22 22:07:52,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 1ec28216a21111f0cdaaac4c6b3ede6f 2023-07-22 22:07:52,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 551e1d69b80e5aaa7cfcfd01fc83603e 2023-07-22 22:07:52,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:07:52,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1ec28216a21111f0cdaaac4c6b3ede6f 2023-07-22 22:07:52,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1ec28216a21111f0cdaaac4c6b3ede6f 2023-07-22 22:07:52,954 INFO [StoreOpener-551e1d69b80e5aaa7cfcfd01fc83603e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 551e1d69b80e5aaa7cfcfd01fc83603e 2023-07-22 22:07:52,954 INFO [StoreOpener-1ec28216a21111f0cdaaac4c6b3ede6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1ec28216a21111f0cdaaac4c6b3ede6f 2023-07-22 22:07:52,956 DEBUG [StoreOpener-551e1d69b80e5aaa7cfcfd01fc83603e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/cf 2023-07-22 22:07:52,956 DEBUG [StoreOpener-1ec28216a21111f0cdaaac4c6b3ede6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/cf 2023-07-22 22:07:52,956 DEBUG [StoreOpener-551e1d69b80e5aaa7cfcfd01fc83603e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/cf 2023-07-22 22:07:52,956 DEBUG [StoreOpener-1ec28216a21111f0cdaaac4c6b3ede6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/cf 2023-07-22 22:07:52,956 INFO [StoreOpener-551e1d69b80e5aaa7cfcfd01fc83603e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 551e1d69b80e5aaa7cfcfd01fc83603e columnFamilyName cf 2023-07-22 22:07:52,956 INFO [StoreOpener-1ec28216a21111f0cdaaac4c6b3ede6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec28216a21111f0cdaaac4c6b3ede6f columnFamilyName cf 2023-07-22 22:07:52,957 INFO [StoreOpener-551e1d69b80e5aaa7cfcfd01fc83603e-1] regionserver.HStore(310): Store=551e1d69b80e5aaa7cfcfd01fc83603e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:07:52,957 INFO [StoreOpener-1ec28216a21111f0cdaaac4c6b3ede6f-1] regionserver.HStore(310): Store=1ec28216a21111f0cdaaac4c6b3ede6f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:07:52,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e 2023-07-22 22:07:52,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f 2023-07-22 22:07:52,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f 2023-07-22 22:07:52,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e 2023-07-22 22:07:52,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1ec28216a21111f0cdaaac4c6b3ede6f 2023-07-22 22:07:52,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 551e1d69b80e5aaa7cfcfd01fc83603e 2023-07-22 22:07:52,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:07:52,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:07:52,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1ec28216a21111f0cdaaac4c6b3ede6f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66057549, jitterRate=-0.01566581428050995}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:07:52,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 551e1d69b80e5aaa7cfcfd01fc83603e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66470608, jitterRate=-0.00951075553894043}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:07:52,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1ec28216a21111f0cdaaac4c6b3ede6f: 2023-07-22 22:07:52,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 551e1d69b80e5aaa7cfcfd01fc83603e: 2023-07-22 22:07:52,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f., pid=93, masterSystemTime=1690063672946 2023-07-22 22:07:52,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e., pid=94, masterSystemTime=1690063672946 2023-07-22 22:07:52,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. 2023-07-22 22:07:52,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. 2023-07-22 22:07:52,966 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=1ec28216a21111f0cdaaac4c6b3ede6f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:52,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:07:52,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:07:52,967 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063672966"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063672966"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063672966"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063672966"}]},"ts":"1690063672966"} 2023-07-22 22:07:52,967 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=551e1d69b80e5aaa7cfcfd01fc83603e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:52,967 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063672967"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063672967"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063672967"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063672967"}]},"ts":"1690063672967"} 2023-07-22 22:07:52,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-22 22:07:52,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 1ec28216a21111f0cdaaac4c6b3ede6f, server=jenkins-hbase4.apache.org,34749,1690063572232 in 174 msec 2023-07-22 22:07:52,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-22 22:07:52,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 551e1d69b80e5aaa7cfcfd01fc83603e, server=jenkins-hbase4.apache.org,36573,1690063572179 in 174 msec 2023-07-22 22:07:52,971 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ec28216a21111f0cdaaac4c6b3ede6f, ASSIGN in 336 msec 2023-07-22 22:07:52,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-22 22:07:52,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=551e1d69b80e5aaa7cfcfd01fc83603e, ASSIGN in 336 msec 2023-07-22 22:07:52,973 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:07:52,973 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063672973"}]},"ts":"1690063672973"} 2023-07-22 22:07:52,974 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-22 22:07:52,976 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:07:52,977 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-22 22:07:52,978 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36573] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 22:07:52,980 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:52,980 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:52,980 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:52,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:52,981 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:07:52,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:52,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:52,982 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 22:07:52,983 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 444 msec 2023-07-22 22:07:53,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 22:07:53,145 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-22 22:07:53,145 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-22 22:07:53,145 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:07:53,148 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-22 22:07:53,149 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:07:53,149 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-22 22:07:53,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:07:53,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063673151 (current time:1690063673151). 2023-07-22 22:07:53,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:07:53,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x0a59b7a2 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:53,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@723a1c2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:53,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:53,165 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:53,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a59b7a2 to 127.0.0.1:64066 2023-07-22 22:07:53,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:53,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x7cc77a6b to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:53,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b6426f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:53,173 DEBUG [hconnection-0x191d8ed1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:53,174 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:53,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:53,180 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:53,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cc77a6b to 127.0.0.1:64066 2023-07-22 22:07:53,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:53,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 22:07:53,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:07:53,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:07:53,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:07:53,185 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:07:53,185 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690064273185 2023-07-22 22:07:53,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:07:53,186 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-22 22:07:53,187 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:07:53,187 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:07:53,188 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:07:53,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 22:07:53,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-22 22:07:53,192 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 22:07:53,196 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690064273196 2023-07-22 22:07:53,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,207 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-22 22:07:53,207 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:53,208 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-22 22:07:53,208 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-22 22:07:53,208 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,208 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,214 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:53,214 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:53,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:53,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:53,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:53,214 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:53,214 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:53,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:53,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:53,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,214 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,214 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,215 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,215 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:07:53,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 22:07:53,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 22:07:53,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,215 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 22:07:53,215 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 22:07:53,215 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,215 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 22:07:53,215 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,216 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:53,216 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 22:07:53,217 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 22:07:53,217 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:53,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 22:07:53,217 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 22:07:53,218 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 22:07:53,217 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 22:07:53,218 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 22:07:53,218 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 22:07:53,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,218 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 22:07:53,218 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,218 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 22:07:53,218 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:53,219 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 22:07:53,219 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 22:07:53,219 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 22:07:53,220 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,220 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,220 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:53,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:53,221 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,221 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:53,221 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,221 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:53,221 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,222 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:53,222 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:53,222 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:53,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:53,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 22:07:53,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1750742e[Count = 1] remaining members to acquire global barrier 2023-07-22 22:07:53,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:53,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:53,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:53,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:53,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:53,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 22:07:53,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1750742e[Count = 0] remaining members to acquire global barrier 2023-07-22 22:07:53,225 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 22:07:53,226 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,227 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,227 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,227 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,227 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:07:53,227 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,227 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:07:53,227 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:07:53,228 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 22:07:53,228 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38207,1690063572104' in zk 2023-07-22 22:07:53,228 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,228 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:07:53,230 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 22:07:53,230 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:53,230 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 22:07:53,235 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:53,235 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. 2023-07-22 22:07:53,235 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:53,235 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:07:53,235 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:53,235 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:53,235 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. started... 2023-07-22 22:07:53,235 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. started... 2023-07-22 22:07:53,237 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 551e1d69b80e5aaa7cfcfd01fc83603e: 2023-07-22 22:07:53,237 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1ec28216a21111f0cdaaac4c6b3ede6f: 2023-07-22 22:07:53,237 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,237 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,237 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:53,237 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:53,237 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:07:53,238 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:07:53,261 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. completed. 2023-07-22 22:07:53,262 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:07:53,262 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:53,263 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:53,264 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,264 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 22:07:53,264 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36573,1690063572179' in zk 2023-07-22 22:07:53,266 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 22:07:53,266 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:53,266 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 22:07:53,267 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,267 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. completed. 2023-07-22 22:07:53,267 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. 2023-07-22 22:07:53,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,267 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:53,267 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:53,267 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:53,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:53,267 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 22:07:53,267 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34749,1690063572232' in zk 2023-07-22 22:07:53,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:53,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:53,269 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,269 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 22:07:53,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,269 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:53,269 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 22:07:53,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:53,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36573,1690063572179': 2023-07-22 22:07:53,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 22:07:53,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:53,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:53,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:53,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:53,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:53,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34749,1690063572232': 2023-07-22 22:07:53,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 22:07:53,276 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-22 22:07:53,276 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:07:53,276 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:07:53,276 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,276 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:07:53,278 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,278 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,278 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:53,278 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,278 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:53,278 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:53,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:53,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:53,278 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:53,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,279 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:53,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:53,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:53,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:53,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:53,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:53,280 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,280 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:53,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:53,284 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,284 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,285 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,287 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:53,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:07:53,288 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,288 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:53,288 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:53,288 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:53,288 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:53,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:53,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:53,288 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:53,288 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,288 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:53,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,288 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:53,288 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,288 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:53,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:53,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:53,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:53,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:53,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:53,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:53,290 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,290 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,290 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,290 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,290 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,290 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,290 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,290 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,290 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:07:53,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:53,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:53,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:53,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:53,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,343 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-22 22:07:53,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,347 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690063673186Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690063673290 (+104 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690063673290Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690063673293 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690063673311 (+18 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690063673343 (+32 ms) 2023-07-22 22:07:53,353 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 22:07:53,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 167 msec 2023-07-22 22:07:53,491 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:53,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:07:53,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:07:53,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36573] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:07:53,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:07:53,518 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-22 22:07:53,518 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:07:53,518 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:07:53,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:07:53,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063673532 (current time:1690063673532). 2023-07-22 22:07:53,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:07:53,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x10ca1f82 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:53,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6554604c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:53,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:53,541 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:53,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10ca1f82 to 127.0.0.1:64066 2023-07-22 22:07:53,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:53,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x3ba6724f to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:07:53,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b504cb6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:07:53,550 DEBUG [hconnection-0x3dc00590-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:53,553 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:53,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:07:53,557 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:07:53,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ba6724f to 127.0.0.1:64066 2023-07-22 22:07:53,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:07:53,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 22:07:53,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:07:53,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:07:53,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:07:53,563 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:07:53,563 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690064273563 2023-07-22 22:07:53,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 22:07:53,563 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-22 22:07:53,564 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:07:53,565 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:07:53,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 22:07:53,566 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 22:07:53,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-22 22:07:53,568 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 22:07:53,568 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690064273568 2023-07-22 22:07:53,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,584 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-22 22:07:53,584 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:53,586 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-22 22:07:53,586 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-22 22:07:53,586 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,586 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,587 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:53,588 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:53,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:53,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:53,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:53,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:53,587 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,588 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:53,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:53,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:53,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,588 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,589 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,589 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,589 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:07:53,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 22:07:53,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,590 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 22:07:53,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 22:07:53,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 22:07:53,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,590 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 22:07:53,590 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 22:07:53,591 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:53,590 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 22:07:53,592 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 22:07:53,593 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 22:07:53,593 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,593 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 22:07:53,593 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,593 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 22:07:53,593 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 22:07:53,593 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:53,593 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:07:53,596 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 22:07:53,596 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 22:07:53,596 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 22:07:53,601 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 22:07:53,601 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 22:07:53,601 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 22:07:53,602 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,602 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:53,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:53,603 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,603 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:53,603 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,604 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,603 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:53,604 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,604 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:53,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:53,604 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,604 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:07:53,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:53,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 22:07:53,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ecfd4d1[Count = 1] remaining members to acquire global barrier 2023-07-22 22:07:53,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:53,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:53,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:53,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:53,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:53,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 22:07:53,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ecfd4d1[Count = 0] remaining members to acquire global barrier 2023-07-22 22:07:53,608 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 22:07:53,608 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,615 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,615 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,615 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,616 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:07:53,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,616 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,616 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:53,616 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:53,616 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:07:53,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,616 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:07:53,616 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 22:07:53,616 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:07:53,616 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:07:53,616 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. 2023-07-22 22:07:53,616 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 22:07:53,616 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. started... 2023-07-22 22:07:53,616 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. started... 2023-07-22 22:07:53,616 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38207,1690063572104' in zk 2023-07-22 22:07:53,616 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,616 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:07:53,616 INFO [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 551e1d69b80e5aaa7cfcfd01fc83603e 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-22 22:07:53,616 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1ec28216a21111f0cdaaac4c6b3ede6f 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-22 22:07:53,618 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 22:07:53,618 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:53,618 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 22:07:53,641 INFO [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/.tmp/cf/8b21ea1940774ff985c7cb84e0bcf221 2023-07-22 22:07:53,642 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/.tmp/cf/b6e17e819e40432db7d0521542bd5444 2023-07-22 22:07:53,655 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/.tmp/cf/b6e17e819e40432db7d0521542bd5444 as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/cf/b6e17e819e40432db7d0521542bd5444 2023-07-22 22:07:53,655 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/.tmp/cf/8b21ea1940774ff985c7cb84e0bcf221 as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/cf/8b21ea1940774ff985c7cb84e0bcf221 2023-07-22 22:07:53,660 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/cf/b6e17e819e40432db7d0521542bd5444, entries=47, sequenceid=6, filesize=8.0 K 2023-07-22 22:07:53,660 INFO [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/cf/8b21ea1940774ff985c7cb84e0bcf221, entries=3, sequenceid=6, filesize=5.0 K 2023-07-22 22:07:53,661 INFO [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 551e1d69b80e5aaa7cfcfd01fc83603e in 45ms, sequenceid=6, compaction requested=false 2023-07-22 22:07:53,661 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 1ec28216a21111f0cdaaac4c6b3ede6f in 45ms, sequenceid=6, compaction requested=false 2023-07-22 22:07:53,661 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-22 22:07:53,661 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-22 22:07:53,664 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 551e1d69b80e5aaa7cfcfd01fc83603e: 2023-07-22 22:07:53,664 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1ec28216a21111f0cdaaac4c6b3ede6f: 2023-07-22 22:07:53,664 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,664 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,665 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:53,665 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:53,665 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/cf/b6e17e819e40432db7d0521542bd5444] hfiles 2023-07-22 22:07:53,665 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:07:53,665 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/cf/b6e17e819e40432db7d0521542bd5444 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,665 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/cf/8b21ea1940774ff985c7cb84e0bcf221] hfiles 2023-07-22 22:07:53,665 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/cf/8b21ea1940774ff985c7cb84e0bcf221 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:07:53,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:07:53,667 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:07:53,683 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. completed. 2023-07-22 22:07:53,683 DEBUG [rs(jenkins-hbase4.apache.org,36573,1690063572179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:07:53,683 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:53,683 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:53,683 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,683 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 22:07:53,683 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36573,1690063572179' in zk 2023-07-22 22:07:53,685 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. completed. 2023-07-22 22:07:53,685 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. 2023-07-22 22:07:53,685 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:07:53,685 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:07:53,685 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,685 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 22:07:53,685 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34749,1690063572232' in zk 2023-07-22 22:07:53,686 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 22:07:53,687 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:53,687 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,687 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 22:07:53,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:53,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:53,688 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 22:07:53,688 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:53,688 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 22:07:53,688 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:53,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36573,1690063572179': 2023-07-22 22:07:53,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 22:07:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:53,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:53,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:53,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34749,1690063572232': 2023-07-22 22:07:53,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 22:07:53,698 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-22 22:07:53,698 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:07:53,699 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:07:53,699 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,699 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:07:53,702 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,702 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:07:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:07:53,702 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,702 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,702 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:53,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,702 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,702 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:53,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:07:53,704 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:53,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:53,704 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:07:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,705 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:07:53,707 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,707 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,707 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:53,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:53,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:53,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:53,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:07:53,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:53,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,711 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:07:53,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:53,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:07:53,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:53,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:07:53,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:53,711 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,711 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:07:53,713 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,713 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:07:53,713 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,713 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:07:53,713 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:07:53,713 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,713 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:53,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:53,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:53,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:07:53,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:53,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:07:53,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,806 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-22 22:07:53,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,806 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690063673564Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690063673713 (+149 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690063673713Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690063673720 (+7 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690063673768 (+48 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690063673806 (+38 ms) 2023-07-22 22:07:53,814 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 22:07:53,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 250 msec 2023-07-22 22:07:53,867 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:07:53,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 22:07:53,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:07:53,868 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063673868 2023-07-22 22:07:53,869 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37905, tgtDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063673868, rawTgtDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063673868, srcFsUri=hdfs://localhost:37905, srcDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:07:53,900 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37905, inputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:07:53,900 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1021391617_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063673868, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063673868/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:53,900 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37905, inputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3, snapshotDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-22 22:07:53,935 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063673868/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:07:54,396 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:54,397 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:54,398 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:54,398 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:54,399 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:54,399 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:54,399 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:54,482 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/hadoop-7034929269305891273.jar 2023-07-22 22:07:54,483 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:54,483 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:54,483 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:54,484 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:54,484 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:54,485 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 22:07:54,485 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 22:07:54,485 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 22:07:54,486 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 22:07:54,486 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 22:07:54,487 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 22:07:54,487 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 22:07:54,487 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 22:07:54,488 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 22:07:54,488 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 22:07:54,488 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 22:07:54,489 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:54,489 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:54,490 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:54,490 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:54,490 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:07:54,490 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:54,491 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:07:55,145 WARN [Listener at jenkins-hbase4.apache.org/35991] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 22:07:55,147 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-22 22:07:56,234 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:56,234 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:07:56,238 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0005_000001 (auth:SIMPLE) 2023-07-22 22:07:56,379 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0006_000001 (auth:SIMPLE) 2023-07-22 22:07:57,042 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:08:03,205 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0006_000001 (auth:SIMPLE) 2023-07-22 22:08:06,719 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 22:08:06,725 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 22:08:06,746 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:08:06,746 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 22:08:06,749 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 22:08:06,749 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2071152985_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:08:06,756 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-22 22:08:06,756 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-22 22:08:06,756 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2071152985_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063673868/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063673868/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:08:06,757 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063673868/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-22 22:08:06,757 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063673868/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-22 22:08:06,763 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-22 22:08:06,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-22 22:08:06,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:08:06,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 22:08:06,769 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063686769"}]},"ts":"1690063686769"} 2023-07-22 22:08:06,771 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-22 22:08:06,773 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-22 22:08:06,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=551e1d69b80e5aaa7cfcfd01fc83603e, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ec28216a21111f0cdaaac4c6b3ede6f, UNASSIGN}] 2023-07-22 22:08:06,777 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=551e1d69b80e5aaa7cfcfd01fc83603e, UNASSIGN 2023-07-22 22:08:06,777 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ec28216a21111f0cdaaac4c6b3ede6f, UNASSIGN 2023-07-22 22:08:06,778 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=551e1d69b80e5aaa7cfcfd01fc83603e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:06,778 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063686778"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063686778"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063686778"}]},"ts":"1690063686778"} 2023-07-22 22:08:06,778 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=1ec28216a21111f0cdaaac4c6b3ede6f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:06,778 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063686778"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063686778"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063686778"}]},"ts":"1690063686778"} 2023-07-22 22:08:06,780 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 551e1d69b80e5aaa7cfcfd01fc83603e, server=jenkins-hbase4.apache.org,36573,1690063572179}] 2023-07-22 22:08:06,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 1ec28216a21111f0cdaaac4c6b3ede6f, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:08:06,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 22:08:06,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1ec28216a21111f0cdaaac4c6b3ede6f 2023-07-22 22:08:06,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 551e1d69b80e5aaa7cfcfd01fc83603e 2023-07-22 22:08:06,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1ec28216a21111f0cdaaac4c6b3ede6f, disabling compactions & flushes 2023-07-22 22:08:06,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 551e1d69b80e5aaa7cfcfd01fc83603e, disabling compactions & flushes 2023-07-22 22:08:06,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. 2023-07-22 22:08:06,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:08:06,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. 2023-07-22 22:08:06,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:08:06,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. after waiting 0 ms 2023-07-22 22:08:06,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. 2023-07-22 22:08:06,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. after waiting 0 ms 2023-07-22 22:08:06,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:08:06,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:08:06,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:08:06,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:06,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:06,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e. 2023-07-22 22:08:06,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 551e1d69b80e5aaa7cfcfd01fc83603e: 2023-07-22 22:08:06,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f. 2023-07-22 22:08:06,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1ec28216a21111f0cdaaac4c6b3ede6f: 2023-07-22 22:08:06,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 551e1d69b80e5aaa7cfcfd01fc83603e 2023-07-22 22:08:06,952 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=551e1d69b80e5aaa7cfcfd01fc83603e, regionState=CLOSED 2023-07-22 22:08:06,952 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063686952"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063686952"}]},"ts":"1690063686952"} 2023-07-22 22:08:06,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1ec28216a21111f0cdaaac4c6b3ede6f 2023-07-22 22:08:06,953 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=1ec28216a21111f0cdaaac4c6b3ede6f, regionState=CLOSED 2023-07-22 22:08:06,953 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690063686953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063686953"}]},"ts":"1690063686953"} 2023-07-22 22:08:06,960 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-22 22:08:06,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-22 22:08:06,960 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 551e1d69b80e5aaa7cfcfd01fc83603e, server=jenkins-hbase4.apache.org,36573,1690063572179 in 173 msec 2023-07-22 22:08:06,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 1ec28216a21111f0cdaaac4c6b3ede6f, server=jenkins-hbase4.apache.org,34749,1690063572232 in 173 msec 2023-07-22 22:08:06,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ec28216a21111f0cdaaac4c6b3ede6f, UNASSIGN in 186 msec 2023-07-22 22:08:06,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-22 22:08:06,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=551e1d69b80e5aaa7cfcfd01fc83603e, UNASSIGN in 186 msec 2023-07-22 22:08:06,962 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063686962"}]},"ts":"1690063686962"} 2023-07-22 22:08:06,963 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-22 22:08:06,965 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-22 22:08:06,966 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 201 msec 2023-07-22 22:08:07,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 22:08:07,071 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-22 22:08:07,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,077 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,079 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,080 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36573] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,083 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,083 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,083 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,083 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,084 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 22:08:07,084 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 22:08:07,084 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e 2023-07-22 22:08:07,084 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 22:08:07,084 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f 2023-07-22 22:08:07,084 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 22:08:07,085 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,085 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:07,085 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,085 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,085 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:07,085 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,085 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:07,085 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:07,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-22 22:08:07,087 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/cf, FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/recovered.edits] 2023-07-22 22:08:07,088 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/cf, FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/recovered.edits] 2023-07-22 22:08:07,096 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/cf/b6e17e819e40432db7d0521542bd5444 to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/cf/b6e17e819e40432db7d0521542bd5444 2023-07-22 22:08:07,100 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/recovered.edits/9.seqid to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f/recovered.edits/9.seqid 2023-07-22 22:08:07,100 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/cf/8b21ea1940774ff985c7cb84e0bcf221 to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/cf/8b21ea1940774ff985c7cb84e0bcf221 2023-07-22 22:08:07,100 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ec28216a21111f0cdaaac4c6b3ede6f 2023-07-22 22:08:07,103 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/recovered.edits/9.seqid to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e/recovered.edits/9.seqid 2023-07-22 22:08:07,104 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testEmptyExportFileSystemState/551e1d69b80e5aaa7cfcfd01fc83603e 2023-07-22 22:08:07,104 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-22 22:08:07,106 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,112 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-22 22:08:07,116 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-22 22:08:07,118 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,118 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-22 22:08:07,118 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063687118"}]},"ts":"9223372036854775807"} 2023-07-22 22:08:07,118 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063687118"}]},"ts":"9223372036854775807"} 2023-07-22 22:08:07,120 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 22:08:07,120 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 551e1d69b80e5aaa7cfcfd01fc83603e, NAME => 'testtb-testEmptyExportFileSystemState,,1690063672536.551e1d69b80e5aaa7cfcfd01fc83603e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1ec28216a21111f0cdaaac4c6b3ede6f, NAME => 'testtb-testEmptyExportFileSystemState,1,1690063672536.1ec28216a21111f0cdaaac4c6b3ede6f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 22:08:07,120 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-22 22:08:07,121 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690063687120"}]},"ts":"9223372036854775807"} 2023-07-22 22:08:07,122 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-22 22:08:07,124 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 22:08:07,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 51 msec 2023-07-22 22:08:07,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-22 22:08:07,188 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-22 22:08:07,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-22 22:08:07,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 22:08:07,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-22 22:08:07,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-22 22:08:07,229 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 761) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2071152985_17 at /127.0.0.1:41248 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2071152985_17 at /127.0.0.1:34226 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1021391617_17 at /127.0.0.1:55080 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2087552140_1 at /127.0.0.1:41206 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:43639 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4594 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 906), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=750 (was 629) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=5387 (was 5938) 2023-07-22 22:08:07,229 WARN [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-22 22:08:07,254 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=750, ProcessCount=180, AvailableMemoryMB=5383 2023-07-22 22:08:07,255 WARN [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-22 22:08:07,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 22:08:07,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,260 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 22:08:07,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-22 22:08:07,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 22:08:07,262 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 22:08:07,264 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d 2023-07-22 22:08:07,264 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49 2023-07-22 22:08:07,265 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d empty. 2023-07-22 22:08:07,265 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49 empty. 2023-07-22 22:08:07,265 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d 2023-07-22 22:08:07,265 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49 2023-07-22 22:08:07,266 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-22 22:08:07,282 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-22 22:08:07,283 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 34e0a11e2ec99e872030d76c3158e78d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:08:07,284 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 89b35a6fb7c4b012a1a7874366cb2d49, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp 2023-07-22 22:08:07,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:08:07,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 34e0a11e2ec99e872030d76c3158e78d, disabling compactions & flushes 2023-07-22 22:08:07,313 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:07,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:07,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. after waiting 0 ms 2023-07-22 22:08:07,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:07,313 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:07,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 34e0a11e2ec99e872030d76c3158e78d: 2023-07-22 22:08:07,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:08:07,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 89b35a6fb7c4b012a1a7874366cb2d49, disabling compactions & flushes 2023-07-22 22:08:07,319 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. 2023-07-22 22:08:07,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. 2023-07-22 22:08:07,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. after waiting 0 ms 2023-07-22 22:08:07,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. 2023-07-22 22:08:07,319 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. 2023-07-22 22:08:07,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 89b35a6fb7c4b012a1a7874366cb2d49: 2023-07-22 22:08:07,321 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 22:08:07,322 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063687322"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063687322"}]},"ts":"1690063687322"} 2023-07-22 22:08:07,322 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063687322"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063687322"}]},"ts":"1690063687322"} 2023-07-22 22:08:07,324 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 22:08:07,325 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 22:08:07,325 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063687325"}]},"ts":"1690063687325"} 2023-07-22 22:08:07,326 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-22 22:08:07,329 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 22:08:07,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 22:08:07,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 22:08:07,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 22:08:07,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 22:08:07,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=34e0a11e2ec99e872030d76c3158e78d, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=89b35a6fb7c4b012a1a7874366cb2d49, ASSIGN}] 2023-07-22 22:08:07,332 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=34e0a11e2ec99e872030d76c3158e78d, ASSIGN 2023-07-22 22:08:07,332 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=89b35a6fb7c4b012a1a7874366cb2d49, ASSIGN 2023-07-22 22:08:07,333 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=34e0a11e2ec99e872030d76c3158e78d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38207,1690063572104; forceNewPlan=false, retain=false 2023-07-22 22:08:07,333 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=89b35a6fb7c4b012a1a7874366cb2d49, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34749,1690063572232; forceNewPlan=false, retain=false 2023-07-22 22:08:07,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 22:08:07,483 INFO [jenkins-hbase4:33185] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 22:08:07,486 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=89b35a6fb7c4b012a1a7874366cb2d49, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,486 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=34e0a11e2ec99e872030d76c3158e78d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,486 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063687486"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063687486"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063687486"}]},"ts":"1690063687486"} 2023-07-22 22:08:07,486 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063687486"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063687486"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063687486"}]},"ts":"1690063687486"} 2023-07-22 22:08:07,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 34e0a11e2ec99e872030d76c3158e78d, server=jenkins-hbase4.apache.org,38207,1690063572104}] 2023-07-22 22:08:07,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 89b35a6fb7c4b012a1a7874366cb2d49, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:08:07,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 22:08:07,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:07,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 34e0a11e2ec99e872030d76c3158e78d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 22:08:07,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. service=AccessControlService 2023-07-22 22:08:07,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:08:07,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 34e0a11e2ec99e872030d76c3158e78d 2023-07-22 22:08:07,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:08:07,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 34e0a11e2ec99e872030d76c3158e78d 2023-07-22 22:08:07,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 34e0a11e2ec99e872030d76c3158e78d 2023-07-22 22:08:07,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. 2023-07-22 22:08:07,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 89b35a6fb7c4b012a1a7874366cb2d49, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 22:08:07,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. service=AccessControlService 2023-07-22 22:08:07,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 22:08:07,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 89b35a6fb7c4b012a1a7874366cb2d49 2023-07-22 22:08:07,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 22:08:07,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 89b35a6fb7c4b012a1a7874366cb2d49 2023-07-22 22:08:07,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 89b35a6fb7c4b012a1a7874366cb2d49 2023-07-22 22:08:07,648 INFO [StoreOpener-34e0a11e2ec99e872030d76c3158e78d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 34e0a11e2ec99e872030d76c3158e78d 2023-07-22 22:08:07,649 INFO [StoreOpener-89b35a6fb7c4b012a1a7874366cb2d49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 89b35a6fb7c4b012a1a7874366cb2d49 2023-07-22 22:08:07,650 DEBUG [StoreOpener-34e0a11e2ec99e872030d76c3158e78d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/cf 2023-07-22 22:08:07,650 DEBUG [StoreOpener-34e0a11e2ec99e872030d76c3158e78d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/cf 2023-07-22 22:08:07,650 INFO [StoreOpener-34e0a11e2ec99e872030d76c3158e78d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34e0a11e2ec99e872030d76c3158e78d columnFamilyName cf 2023-07-22 22:08:07,651 INFO [StoreOpener-34e0a11e2ec99e872030d76c3158e78d-1] regionserver.HStore(310): Store=34e0a11e2ec99e872030d76c3158e78d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:08:07,652 DEBUG [StoreOpener-89b35a6fb7c4b012a1a7874366cb2d49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/cf 2023-07-22 22:08:07,652 DEBUG [StoreOpener-89b35a6fb7c4b012a1a7874366cb2d49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/cf 2023-07-22 22:08:07,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d 2023-07-22 22:08:07,652 INFO [StoreOpener-89b35a6fb7c4b012a1a7874366cb2d49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89b35a6fb7c4b012a1a7874366cb2d49 columnFamilyName cf 2023-07-22 22:08:07,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d 2023-07-22 22:08:07,653 INFO [StoreOpener-89b35a6fb7c4b012a1a7874366cb2d49-1] regionserver.HStore(310): Store=89b35a6fb7c4b012a1a7874366cb2d49/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 22:08:07,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49 2023-07-22 22:08:07,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49 2023-07-22 22:08:07,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 34e0a11e2ec99e872030d76c3158e78d 2023-07-22 22:08:07,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 89b35a6fb7c4b012a1a7874366cb2d49 2023-07-22 22:08:07,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:08:07,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 34e0a11e2ec99e872030d76c3158e78d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64306604, jitterRate=-0.04175692796707153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:08:07,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 34e0a11e2ec99e872030d76c3158e78d: 2023-07-22 22:08:07,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 22:08:07,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d., pid=108, masterSystemTime=1690063687640 2023-07-22 22:08:07,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 89b35a6fb7c4b012a1a7874366cb2d49; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66135083, jitterRate=-0.014510467648506165}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 22:08:07,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 89b35a6fb7c4b012a1a7874366cb2d49: 2023-07-22 22:08:07,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49., pid=109, masterSystemTime=1690063687640 2023-07-22 22:08:07,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:07,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:07,675 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=34e0a11e2ec99e872030d76c3158e78d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,676 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063687675"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063687675"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063687675"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063687675"}]},"ts":"1690063687675"} 2023-07-22 22:08:07,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. 2023-07-22 22:08:07,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. 2023-07-22 22:08:07,676 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=89b35a6fb7c4b012a1a7874366cb2d49, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,676 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063687676"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690063687676"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690063687676"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690063687676"}]},"ts":"1690063687676"} 2023-07-22 22:08:07,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-22 22:08:07,680 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 34e0a11e2ec99e872030d76c3158e78d, server=jenkins-hbase4.apache.org,38207,1690063572104 in 189 msec 2023-07-22 22:08:07,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-22 22:08:07,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 89b35a6fb7c4b012a1a7874366cb2d49, server=jenkins-hbase4.apache.org,34749,1690063572232 in 190 msec 2023-07-22 22:08:07,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=34e0a11e2ec99e872030d76c3158e78d, ASSIGN in 350 msec 2023-07-22 22:08:07,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-22 22:08:07,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=89b35a6fb7c4b012a1a7874366cb2d49, ASSIGN in 350 msec 2023-07-22 22:08:07,686 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 22:08:07,686 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063687686"}]},"ts":"1690063687686"} 2023-07-22 22:08:07,687 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-22 22:08:07,689 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 22:08:07,689 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-22 22:08:07,691 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36573] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 22:08:07,692 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:07,692 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:07,692 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:07,692 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:07,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 22:08:07,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 22:08:07,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 22:08:07,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 22:08:07,694 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 436 msec 2023-07-22 22:08:07,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 22:08:07,864 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-22 22:08:07,864 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-22 22:08:07,865 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:08:07,868 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-22 22:08:07,868 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:08:07,868 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-22 22:08:07,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 22:08:07,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063687871 (current time:1690063687871). 2023-07-22 22:08:07,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:08:07,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x51ea7b7d to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:08:07,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d17eed7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:08:07,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:08:07,888 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:08:07,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51ea7b7d to 127.0.0.1:64066 2023-07-22 22:08:07,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:07,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x35436f08 to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:08:07,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3770cb4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:08:07,897 DEBUG [hconnection-0x7553fa21-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:08:07,900 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:08:07,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:08:07,905 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:08:07,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35436f08 to 127.0.0.1:64066 2023-07-22 22:08:07,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:07,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 22:08:07,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:08:07,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 22:08:07,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 22:08:07,910 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 22:08:07,910 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690064287910 2023-07-22 22:08:07,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 22:08:07,910 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,911 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:08:07,911 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:08:07,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 22:08:07,912 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 22:08:07,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-07-22 22:08:07,914 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 22:08:07,914 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690064287914 2023-07-22 22:08:07,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,924 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-22 22:08:07,924 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:07,924 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-22 22:08:07,924 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-22 22:08:07,925 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,925 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,927 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:07,927 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:07,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:07,927 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:07,927 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:07,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:07,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:07,927 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:07,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:07,927 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,928 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,928 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:08:07,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 22:08:07,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 22:08:07,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 22:08:07,928 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 22:08:07,928 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 22:08:07,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,929 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 22:08:07,929 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,929 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 22:08:07,929 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:07,929 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,930 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 22:08:07,930 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 22:08:07,929 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,930 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 22:08:07,930 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 22:08:07,930 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:07,930 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 22:08:07,931 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 22:08:07,931 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:07,931 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 22:08:07,932 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 22:08:07,932 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 22:08:07,932 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 22:08:07,932 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 22:08:07,935 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,935 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:07,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:07,936 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,936 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,936 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:08:07,936 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,936 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:07,936 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,936 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:08:07,936 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,936 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:08:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:07,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:07,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 22:08:07,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12d55e6[Count = 1] remaining members to acquire global barrier 2023-07-22 22:08:07,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:07,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:07,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:07,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:07,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 22:08:07,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12d55e6[Count = 0] remaining members to acquire global barrier 2023-07-22 22:08:07,940 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-22 22:08:07,940 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,943 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,943 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,943 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,943 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 22:08:07,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,943 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,943 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 22:08:07,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,943 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:08:07,943 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:08:07,943 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 22:08:07,944 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:07,944 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:08:07,944 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. started... 2023-07-22 22:08:07,944 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,944 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:08:07,944 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:08:07,944 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. 2023-07-22 22:08:07,945 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 34e0a11e2ec99e872030d76c3158e78d: 2023-07-22 22:08:07,944 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 22:08:07,945 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. started... 2023-07-22 22:08:07,945 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36573,1690063572179' in zk 2023-07-22 22:08:07,945 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,946 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 89b35a6fb7c4b012a1a7874366cb2d49: 2023-07-22 22:08:07,946 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:08:07,946 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:08:07,946 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,946 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:08:07,946 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 22:08:07,947 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 22:08:07,947 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:07,947 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 22:08:07,959 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. completed. 2023-07-22 22:08:07,959 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. 2023-07-22 22:08:07,959 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:08:07,959 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:08:07,959 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,959 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 22:08:07,959 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34749,1690063572232' in zk 2023-07-22 22:08:07,960 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,960 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 22:08:07,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:07,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:07,961 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:07,961 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 22:08:07,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:07,962 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. completed. 2023-07-22 22:08:07,962 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:07,962 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:08:07,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:07,962 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:08:07,963 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,963 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 22:08:07,963 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38207,1690063572104' in zk 2023-07-22 22:08:07,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,964 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,964 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 22:08:07,964 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:07,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,964 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 22:08:07,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:07,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:07,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:07,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34749,1690063572232': 2023-07-22 22:08:07,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-22 22:08:07,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:07,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:07,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:07,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:07,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:07,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:07,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:07,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38207,1690063572104': 2023-07-22 22:08:07,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-22 22:08:07,970 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-22 22:08:07,970 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:08:07,970 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:08:07,970 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,970 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:08:07,973 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,973 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:07,973 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,973 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,973 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:07,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,973 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:07,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,973 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:07,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:07,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:07,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,974 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:07,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:07,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:07,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:07,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:07,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:07,974 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,975 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:07,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:07,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:07,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:07,977 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,977 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,977 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:07,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:07,980 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:07,980 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:07,980 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:07,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:07,980 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:07,980 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:07,980 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:07,981 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,980 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,981 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:07,981 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,981 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:07,981 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,981 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:07,981 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:07,980 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:07,981 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,981 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:07,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:07,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:07,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:07,982 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:07,982 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:07,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:07,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:07,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:07,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:07,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:08,012 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:08:08,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 22:08:08,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:08:08,014 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:08:08,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,108 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-22 22:08:08,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,109 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690063687910Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690063687981 (+71 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690063687981Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690063687985 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690063688023 (+38 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690063688108 (+85 ms) 2023-07-22 22:08:08,111 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 22:08:08,113 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 201 msec 2023-07-22 22:08:08,214 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:08:08,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 22:08:08,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:08:08,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38207] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:08:08,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 22:08:08,229 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,230 DEBUG [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:08,230 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 22:08:08,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 22:08:08,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690063688241 (current time:1690063688241). 2023-07-22 22:08:08,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 22:08:08,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x450b9b0b to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:08:08,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f63e379, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:08:08,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:08:08,254 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:08:08,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x450b9b0b to 127.0.0.1:64066 2023-07-22 22:08:08,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:08,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(139): Connect 0x298b24ec to 127.0.0.1:64066 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 22:08:08,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30413115, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 22:08:08,364 DEBUG [hconnection-0x89644f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:08:08,365 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45026, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:08:08,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 22:08:08,373 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 22:08:08,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x298b24ec to 127.0.0.1:64066 2023-07-22 22:08:08,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:08,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 22:08:08,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 22:08:08,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 22:08:08,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 22:08:08,380 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 22:08:08,380 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690064288380 2023-07-22 22:08:08,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 22:08:08,380 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,382 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 22:08:08,382 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 22:08:08,383 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 22:08:08,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 22:08:08,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-22 22:08:08,386 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 22:08:08,386 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690064288386 2023-07-22 22:08:08,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,404 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-22 22:08:08,404 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:08,406 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-22 22:08:08,406 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-22 22:08:08,406 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,406 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,408 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:08,408 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:08,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:08,408 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:08,408 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:08,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:08,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:08,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:08,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:08,408 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,408 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,409 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,409 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 22:08:08,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 22:08:08,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,410 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 22:08:08,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 22:08:08,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,410 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 22:08:08,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 22:08:08,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,410 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 22:08:08,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,411 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 22:08:08,411 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 22:08:08,411 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:08,411 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,412 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 22:08:08,412 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 22:08:08,412 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:08,411 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 22:08:08,413 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 22:08:08,415 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 22:08:08,415 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 22:08:08,412 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 22:08:08,415 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 22:08:08,415 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36573,1690063572179' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 22:08:08,415 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 22:08:08,415 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 22:08:08,416 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,416 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:08,418 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,418 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,418 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,418 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,418 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:08:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:08,419 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,419 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:08:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:08,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:08,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38207,1690063572104' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 22:08:08,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eb0a2a4[Count = 1] remaining members to acquire global barrier 2023-07-22 22:08:08,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:08,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,422 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,422 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 22:08:08,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:08,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:08,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34749,1690063572232' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 22:08:08,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eb0a2a4[Count = 0] remaining members to acquire global barrier 2023-07-22 22:08:08,422 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-22 22:08:08,423 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,427 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,427 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,427 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,427 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 22:08:08,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,428 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 22:08:08,428 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:08:08,428 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:08:08,428 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 22:08:08,428 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 22:08:08,428 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36573,1690063572179' in zk 2023-07-22 22:08:08,428 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,428 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. 2023-07-22 22:08:08,428 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 22:08:08,428 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:08,428 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,429 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 22:08:08,428 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 22:08:08,428 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. started... 2023-07-22 22:08:08,429 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. started... 2023-07-22 22:08:08,429 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 34e0a11e2ec99e872030d76c3158e78d 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-22 22:08:08,429 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 89b35a6fb7c4b012a1a7874366cb2d49 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-22 22:08:08,430 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 22:08:08,430 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:08,430 DEBUG [member: 'jenkins-hbase4.apache.org,36573,1690063572179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 22:08:08,443 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/.tmp/cf/c6623e2ac47b4b69a1ac9f9a45a8c4bd 2023-07-22 22:08:08,445 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/.tmp/cf/2d2f5311aa2847be9940a4fc8c1d5cf6 2023-07-22 22:08:08,449 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/.tmp/cf/c6623e2ac47b4b69a1ac9f9a45a8c4bd as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/cf/c6623e2ac47b4b69a1ac9f9a45a8c4bd 2023-07-22 22:08:08,452 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/.tmp/cf/2d2f5311aa2847be9940a4fc8c1d5cf6 as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/cf/2d2f5311aa2847be9940a4fc8c1d5cf6 2023-07-22 22:08:08,457 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/cf/c6623e2ac47b4b69a1ac9f9a45a8c4bd, entries=4, sequenceid=6, filesize=5.1 K 2023-07-22 22:08:08,458 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/cf/2d2f5311aa2847be9940a4fc8c1d5cf6, entries=46, sequenceid=6, filesize=7.9 K 2023-07-22 22:08:08,458 INFO [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 34e0a11e2ec99e872030d76c3158e78d in 29ms, sequenceid=6, compaction requested=false 2023-07-22 22:08:08,459 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-22 22:08:08,459 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 34e0a11e2ec99e872030d76c3158e78d: 2023-07-22 22:08:08,459 INFO [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 89b35a6fb7c4b012a1a7874366cb2d49 in 30ms, sequenceid=6, compaction requested=false 2023-07-22 22:08:08,461 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 89b35a6fb7c4b012a1a7874366cb2d49: 2023-07-22 22:08:08,461 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,461 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:08:08,461 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,461 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/cf/c6623e2ac47b4b69a1ac9f9a45a8c4bd] hfiles 2023-07-22 22:08:08,461 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/cf/c6623e2ac47b4b69a1ac9f9a45a8c4bd for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,461 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 22:08:08,461 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/cf/2d2f5311aa2847be9940a4fc8c1d5cf6] hfiles 2023-07-22 22:08:08,461 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/cf/2d2f5311aa2847be9940a4fc8c1d5cf6 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,482 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:08:08,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 22:08:08,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 22:08:08,483 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 22:08:08,507 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. completed. 2023-07-22 22:08:08,507 DEBUG [rs(jenkins-hbase4.apache.org,34749,1690063572232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. 2023-07-22 22:08:08,507 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:08:08,507 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:08:08,507 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,507 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 22:08:08,507 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34749,1690063572232' in zk 2023-07-22 22:08:08,509 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. completed. 2023-07-22 22:08:08,509 DEBUG [rs(jenkins-hbase4.apache.org,38207,1690063572104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:08,509 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 22:08:08,510 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 22:08:08,510 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,510 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 22:08:08,510 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38207,1690063572104' in zk 2023-07-22 22:08:08,510 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,510 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 22:08:08,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:08,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:08,510 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:08,510 DEBUG [member: 'jenkins-hbase4.apache.org,34749,1690063572232' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 22:08:08,513 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:08,513 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 22:08:08,513 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:08,513 DEBUG [member: 'jenkins-hbase4.apache.org,38207,1690063572104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 22:08:08,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:08,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:08,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:08,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:08,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34749,1690063572232': 2023-07-22 22:08:08,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34749,1690063572232' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-22 22:08:08,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:08,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:08,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:08,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:08,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38207,1690063572104': 2023-07-22 22:08:08,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38207,1690063572104' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-22 22:08:08,524 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-22 22:08:08,524 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 22:08:08,525 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 22:08:08,525 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,525 INFO [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 22:08:08,527 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,527 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,527 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,527 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:08,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 22:08:08,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 22:08:08,527 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:08,527 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,527 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:08,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,527 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:08,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:08,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 22:08:08,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:08,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:08,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:08,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:08,528 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,529 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:08,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 22:08:08,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:08,530 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 22:08:08,531 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,531 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:08,534 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:08,534 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:08,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:08,534 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:08,534 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 22:08:08,534 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:08,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:08,534 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 22:08:08,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:08,534 DEBUG [(jenkins-hbase4.apache.org,33185,1690063570571)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 22:08:08,534 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 22:08:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 22:08:08,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:08,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 22:08:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 22:08:08,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,537 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:08,537 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,537 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,537 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,537 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,537 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:08,537 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,537 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:08,537 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:08,537 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,537 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,582 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-22 22:08:08,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,585 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690063688381Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690063688534 (+153 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690063688534Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690063688539 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690063688554 (+15 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690063688582 (+28 ms) 2023-07-22 22:08:08,589 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 22:08:08,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 207 msec 2023-07-22 22:08:08,683 DEBUG [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 22:08:08,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 22:08:08,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 22:08:08,685 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063688685 2023-07-22 22:08:08,685 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37905, tgtDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063688685, rawTgtDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063688685, srcFsUri=hdfs://localhost:37905, srcDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:08:08,711 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37905, inputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3 2023-07-22 22:08:08,711 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_668146249_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063688685, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063688685/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,711 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37905, inputRoot=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3, snapshotDir=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-22 22:08:08,723 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063688685/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:08,758 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:08,759 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:08,759 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:08,759 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:08,760 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:08,760 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:08,761 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:08,838 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/hadoop-1894342683538221650.jar 2023-07-22 22:08:08,839 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:08,839 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:08,839 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:08,840 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:08,840 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:08,841 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 22:08:08,841 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 22:08:08,841 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 22:08:08,842 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 22:08:08,842 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 22:08:08,843 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 22:08:08,843 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 22:08:08,844 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 22:08:08,844 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 22:08:08,844 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 22:08:08,845 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 22:08:08,845 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:08:08,846 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:08:08,846 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:08:08,847 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:08:08,847 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 22:08:08,847 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:08:08,848 DEBUG [Listener at jenkins-hbase4.apache.org/35991] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 22:08:09,347 WARN [Listener at jenkins-hbase4.apache.org/35991] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 22:08:09,350 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-22 22:08:09,352 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-22 22:08:10,978 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:08:10,978 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 22:08:10,981 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0006_000001 (auth:SIMPLE) 2023-07-22 22:08:11,251 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0007_000001 (auth:SIMPLE) 2023-07-22 22:08:12,570 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:08:17,123 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0007_000001 (auth:SIMPLE) 2023-07-22 22:08:19,444 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690063580416_0007_000001 (auth:SIMPLE) 2023-07-22 22:08:24,599 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 22:08:24,599 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 22:08:24,642 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,642 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 22:08:24,643 INFO [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 22:08:24,643 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2071152985_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,644 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-22 22:08:24,644 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-22 22:08:24,644 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2071152985_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063688685/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063688685/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,645 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063688685/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-22 22:08:24,645 DEBUG [Listener at jenkins-hbase4.apache.org/35991] snapshot.TestExportSnapshot(367): hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/export-test/export-1690063688685/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-22 22:08:24,656 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 22:08:24,661 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063704661"}]},"ts":"1690063704661"} 2023-07-22 22:08:24,663 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-22 22:08:24,665 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-22 22:08:24,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=34e0a11e2ec99e872030d76c3158e78d, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=89b35a6fb7c4b012a1a7874366cb2d49, UNASSIGN}] 2023-07-22 22:08:24,668 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=34e0a11e2ec99e872030d76c3158e78d, UNASSIGN 2023-07-22 22:08:24,668 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=89b35a6fb7c4b012a1a7874366cb2d49, UNASSIGN 2023-07-22 22:08:24,668 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=34e0a11e2ec99e872030d76c3158e78d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:24,668 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=89b35a6fb7c4b012a1a7874366cb2d49, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:24,668 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063704668"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063704668"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063704668"}]},"ts":"1690063704668"} 2023-07-22 22:08:24,668 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063704668"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690063704668"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690063704668"}]},"ts":"1690063704668"} 2023-07-22 22:08:24,671 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 89b35a6fb7c4b012a1a7874366cb2d49, server=jenkins-hbase4.apache.org,34749,1690063572232}] 2023-07-22 22:08:24,672 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 34e0a11e2ec99e872030d76c3158e78d, server=jenkins-hbase4.apache.org,38207,1690063572104}] 2023-07-22 22:08:24,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 22:08:24,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 34e0a11e2ec99e872030d76c3158e78d 2023-07-22 22:08:24,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 89b35a6fb7c4b012a1a7874366cb2d49 2023-07-22 22:08:24,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 34e0a11e2ec99e872030d76c3158e78d, disabling compactions & flushes 2023-07-22 22:08:24,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 89b35a6fb7c4b012a1a7874366cb2d49, disabling compactions & flushes 2023-07-22 22:08:24,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:24,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:24,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. after waiting 0 ms 2023-07-22 22:08:24,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:24,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. 2023-07-22 22:08:24,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. 2023-07-22 22:08:24,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. after waiting 0 ms 2023-07-22 22:08:24,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. 2023-07-22 22:08:24,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:08:24,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:24,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d. 2023-07-22 22:08:24,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 34e0a11e2ec99e872030d76c3158e78d: 2023-07-22 22:08:24,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 34e0a11e2ec99e872030d76c3158e78d 2023-07-22 22:08:24,846 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=34e0a11e2ec99e872030d76c3158e78d, regionState=CLOSED 2023-07-22 22:08:24,846 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063704846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063704846"}]},"ts":"1690063704846"} 2023-07-22 22:08:24,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:08:24,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:24,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49. 2023-07-22 22:08:24,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 89b35a6fb7c4b012a1a7874366cb2d49: 2023-07-22 22:08:24,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 89b35a6fb7c4b012a1a7874366cb2d49 2023-07-22 22:08:24,860 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=89b35a6fb7c4b012a1a7874366cb2d49, regionState=CLOSED 2023-07-22 22:08:24,860 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690063704860"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690063704860"}]},"ts":"1690063704860"} 2023-07-22 22:08:24,862 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-22 22:08:24,862 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 34e0a11e2ec99e872030d76c3158e78d, server=jenkins-hbase4.apache.org,38207,1690063572104 in 188 msec 2023-07-22 22:08:24,863 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=34e0a11e2ec99e872030d76c3158e78d, UNASSIGN in 197 msec 2023-07-22 22:08:24,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-22 22:08:24,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 89b35a6fb7c4b012a1a7874366cb2d49, server=jenkins-hbase4.apache.org,34749,1690063572232 in 191 msec 2023-07-22 22:08:24,866 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-22 22:08:24,866 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=89b35a6fb7c4b012a1a7874366cb2d49, UNASSIGN in 199 msec 2023-07-22 22:08:24,866 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690063704866"}]},"ts":"1690063704866"} 2023-07-22 22:08:24,870 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-22 22:08:24,872 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-22 22:08:24,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 216 msec 2023-07-22 22:08:24,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 22:08:24,963 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-22 22:08:24,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,968 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,969 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,970 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36573] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,973 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d 2023-07-22 22:08:24,973 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49 2023-07-22 22:08:24,975 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,975 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,975 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,975 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,976 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/cf, FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/recovered.edits] 2023-07-22 22:08:24,976 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/cf, FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/recovered.edits] 2023-07-22 22:08:24,980 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/cf/2d2f5311aa2847be9940a4fc8c1d5cf6 to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/cf/2d2f5311aa2847be9940a4fc8c1d5cf6 2023-07-22 22:08:24,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 22:08:24,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 22:08:24,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 22:08:24,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 22:08:24,981 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/cf/c6623e2ac47b4b69a1ac9f9a45a8c4bd to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/cf/c6623e2ac47b4b69a1ac9f9a45a8c4bd 2023-07-22 22:08:24,981 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,981 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:24,981 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,981 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:24,982 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,982 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:24,982 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,982 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 22:08:24,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-22 22:08:24,987 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/recovered.edits/9.seqid to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49/recovered.edits/9.seqid 2023-07-22 22:08:24,987 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/recovered.edits/9.seqid to hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d/recovered.edits/9.seqid 2023-07-22 22:08:24,988 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/89b35a6fb7c4b012a1a7874366cb2d49 2023-07-22 22:08:24,988 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34e0a11e2ec99e872030d76c3158e78d 2023-07-22 22:08:24,988 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-22 22:08:24,990 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:24,993 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-22 22:08:24,997 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-22 22:08:25,002 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:25,002 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-22 22:08:25,002 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063705002"}]},"ts":"9223372036854775807"} 2023-07-22 22:08:25,003 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690063705002"}]},"ts":"9223372036854775807"} 2023-07-22 22:08:25,005 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 22:08:25,005 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 34e0a11e2ec99e872030d76c3158e78d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690063687256.34e0a11e2ec99e872030d76c3158e78d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 89b35a6fb7c4b012a1a7874366cb2d49, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690063687256.89b35a6fb7c4b012a1a7874366cb2d49.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 22:08:25,005 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-22 22:08:25,005 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690063705005"}]},"ts":"9223372036854775807"} 2023-07-22 22:08:25,007 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-22 22:08:25,009 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:25,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 45 msec 2023-07-22 22:08:25,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-22 22:08:25,085 INFO [Listener at jenkins-hbase4.apache.org/35991] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-22 22:08:25,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-22 22:08:25,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:25,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-22 22:08:25,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33185] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 22:08:25,152 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 762) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5201 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2071152985_17 at /127.0.0.1:46388 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2071152985_17 at /127.0.0.1:33192 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x55b0e353-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:38829 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2071152985_17 at /127.0.0.1:60506 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2000802193_1 at /127.0.0.1:60476 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2000802193_1 at /127.0.0.1:46376 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 906), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=721 (was 750), ProcessCount=183 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=4745 (was 5383) 2023-07-22 22:08:25,152 WARN [Listener at jenkins-hbase4.apache.org/35991] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-22 22:08:25,152 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-22 22:08:25,165 INFO [Listener at jenkins-hbase4.apache.org/35991] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 22:08:25,279 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1690063580416_0007_01_000001 is : 143 2023-07-22 22:08:30,422 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 22:08:39,292 INFO [Listener at jenkins-hbase4.apache.org/35991] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 22:08:53,419 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 22:08:53,420 INFO [Listener at jenkins-hbase4.apache.org/35991] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 22:08:53,534 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-22 22:08:53,545 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-22 22:08:53,546 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 22:08:53,559 INFO [Listener at jenkins-hbase4.apache.org/35991] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 22:08:53,663 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 22:08:53,663 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-22 22:08:53,663 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-22 22:08:53,663 INFO [Listener at jenkins-hbase4.apache.org/35991] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-22 22:08:53,663 DEBUG [Listener at jenkins-hbase4.apache.org/35991] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x504158e6 to 127.0.0.1:64066 2023-07-22 22:08:53,663 DEBUG [Listener at jenkins-hbase4.apache.org/35991] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:53,664 DEBUG [Listener at jenkins-hbase4.apache.org/35991] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-22 22:08:53,664 DEBUG [Listener at jenkins-hbase4.apache.org/35991] util.JVMClusterUtil(257): Found active master hash=1484265873, stopped=false 2023-07-22 22:08:53,664 DEBUG [Listener at jenkins-hbase4.apache.org/35991] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:53,664 DEBUG [Listener at jenkins-hbase4.apache.org/35991] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-22 22:08:53,664 INFO [Listener at jenkins-hbase4.apache.org/35991] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33185,1690063570571 2023-07-22 22:08:53,666 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 22:08:53,666 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 22:08:53,666 INFO [Listener at jenkins-hbase4.apache.org/35991] procedure2.ProcedureExecutor(629): Stopping 2023-07-22 22:08:53,666 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 22:08:53,666 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:08:53,666 DEBUG [Listener at jenkins-hbase4.apache.org/35991] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3036fce1 to 127.0.0.1:64066 2023-07-22 22:08:53,666 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 22:08:53,666 DEBUG [Listener at jenkins-hbase4.apache.org/35991] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:53,667 INFO [Listener at jenkins-hbase4.apache.org/35991] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38207,1690063572104' ***** 2023-07-22 22:08:53,667 DEBUG [Listener at jenkins-hbase4.apache.org/35991] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:53,667 INFO [Listener at jenkins-hbase4.apache.org/35991] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 22:08:53,667 INFO [Listener at jenkins-hbase4.apache.org/35991] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36573,1690063572179' ***** 2023-07-22 22:08:53,667 DEBUG [Listener at jenkins-hbase4.apache.org/35991] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:53,667 INFO [Listener at jenkins-hbase4.apache.org/35991] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 22:08:53,667 INFO [Listener at jenkins-hbase4.apache.org/35991] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34749,1690063572232' ***** 2023-07-22 22:08:53,667 INFO [RS:1;jenkins-hbase4:36573] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 22:08:53,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:08:53,668 INFO [RS:1;jenkins-hbase4:36573] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 22:08:53,667 DEBUG [Listener at jenkins-hbase4.apache.org/35991] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:53,667 INFO [RS:0;jenkins-hbase4:38207] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 22:08:53,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:08:53,668 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 22:08:53,668 INFO [RS:0;jenkins-hbase4:38207] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 22:08:53,668 INFO [RS:0;jenkins-hbase4:38207] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 22:08:53,668 INFO [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:53,668 INFO [Listener at jenkins-hbase4.apache.org/35991] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 22:08:53,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:08:53,668 INFO [RS:1;jenkins-hbase4:36573] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 22:08:53,668 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 22:08:53,669 INFO [RS:2;jenkins-hbase4:34749] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 22:08:53,669 INFO [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(3305): Received CLOSE for 034a80e600f0b0a59826ec1f748ad64f 2023-07-22 22:08:53,668 DEBUG [RS:0;jenkins-hbase4:38207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x527cf3c0 to 127.0.0.1:64066 2023-07-22 22:08:53,669 DEBUG [RS:0;jenkins-hbase4:38207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:53,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 22:08:53,669 INFO [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:53,669 DEBUG [RS:1;jenkins-hbase4:36573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cf5e2c4 to 127.0.0.1:64066 2023-07-22 22:08:53,672 DEBUG [RS:1;jenkins-hbase4:36573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:53,669 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 22:08:53,669 INFO [RS:2;jenkins-hbase4:34749] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 22:08:53,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 034a80e600f0b0a59826ec1f748ad64f, disabling compactions & flushes 2023-07-22 22:08:53,672 INFO [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38207,1690063572104; all regions closed. 2023-07-22 22:08:53,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f. 2023-07-22 22:08:53,672 INFO [RS:2;jenkins-hbase4:34749] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 22:08:53,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f. 2023-07-22 22:08:53,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f. after waiting 0 ms 2023-07-22 22:08:53,673 INFO [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(3305): Received CLOSE for c8b5ff07971d42c84313908b84ff2b6a 2023-07-22 22:08:53,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f. 2023-07-22 22:08:53,673 INFO [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:53,673 DEBUG [RS:2;jenkins-hbase4:34749] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25b70c02 to 127.0.0.1:64066 2023-07-22 22:08:53,673 DEBUG [RS:2;jenkins-hbase4:34749] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:53,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 034a80e600f0b0a59826ec1f748ad64f 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-22 22:08:53,673 INFO [RS:2;jenkins-hbase4:34749] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 22:08:53,673 INFO [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-22 22:08:53,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c8b5ff07971d42c84313908b84ff2b6a, disabling compactions & flushes 2023-07-22 22:08:53,674 DEBUG [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(1478): Online Regions={034a80e600f0b0a59826ec1f748ad64f=hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f.} 2023-07-22 22:08:53,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a. 2023-07-22 22:08:53,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a. 2023-07-22 22:08:53,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a. after waiting 0 ms 2023-07-22 22:08:53,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a. 2023-07-22 22:08:53,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c8b5ff07971d42c84313908b84ff2b6a 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-22 22:08:53,673 INFO [RS:2;jenkins-hbase4:34749] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 22:08:53,674 INFO [RS:2;jenkins-hbase4:34749] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 22:08:53,674 INFO [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-22 22:08:53,674 DEBUG [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(1504): Waiting on 034a80e600f0b0a59826ec1f748ad64f 2023-07-22 22:08:53,675 INFO [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-22 22:08:53,675 DEBUG [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, c8b5ff07971d42c84313908b84ff2b6a=hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a.} 2023-07-22 22:08:53,675 DEBUG [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(1504): Waiting on 1588230740, c8b5ff07971d42c84313908b84ff2b6a 2023-07-22 22:08:53,676 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-22 22:08:53,676 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-22 22:08:53,676 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-22 22:08:53,676 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-22 22:08:53,676 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-22 22:08:53,676 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-22 22:08:53,678 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-22 22:08:53,678 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-22 22:08:53,679 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-22 22:08:53,679 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-22 22:08:53,680 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 22:08:53,690 DEBUG [RS:0;jenkins-hbase4:38207] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/oldWALs 2023-07-22 22:08:53,690 INFO [RS:0;jenkins-hbase4:38207] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38207%2C1690063572104:(num 1690063574887) 2023-07-22 22:08:53,690 DEBUG [RS:0;jenkins-hbase4:38207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:53,690 INFO [RS:0;jenkins-hbase4:38207] regionserver.LeaseManager(133): Closed leases 2023-07-22 22:08:53,690 INFO [RS:0;jenkins-hbase4:38207] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-22 22:08:53,693 INFO [RS:0;jenkins-hbase4:38207] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 22:08:53,693 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 22:08:53,693 INFO [RS:0;jenkins-hbase4:38207] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 22:08:53,693 INFO [RS:0;jenkins-hbase4:38207] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 22:08:53,694 INFO [RS:0;jenkins-hbase4:38207] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38207 2023-07-22 22:08:53,709 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/.tmp/info/ad0b4c78a51f4ab483177ea36f958de3 2023-07-22 22:08:53,711 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 22:08:53,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/acl/034a80e600f0b0a59826ec1f748ad64f/.tmp/l/f41caabf99df44ca8d29515ec170210d 2023-07-22 22:08:53,715 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:08:53,715 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:53,715 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:53,715 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38207,1690063572104 2023-07-22 22:08:53,715 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:08:53,715 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:08:53,715 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:08:53,717 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38207,1690063572104] 2023-07-22 22:08:53,717 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 22:08:53,717 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38207,1690063572104; numProcessing=1 2023-07-22 22:08:53,717 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ad0b4c78a51f4ab483177ea36f958de3 2023-07-22 22:08:53,720 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38207,1690063572104 already deleted, retry=false 2023-07-22 22:08:53,720 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38207,1690063572104 expired; onlineServers=2 2023-07-22 22:08:53,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f41caabf99df44ca8d29515ec170210d 2023-07-22 22:08:53,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/acl/034a80e600f0b0a59826ec1f748ad64f/.tmp/l/f41caabf99df44ca8d29515ec170210d as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/acl/034a80e600f0b0a59826ec1f748ad64f/l/f41caabf99df44ca8d29515ec170210d 2023-07-22 22:08:53,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f41caabf99df44ca8d29515ec170210d 2023-07-22 22:08:53,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/acl/034a80e600f0b0a59826ec1f748ad64f/l/f41caabf99df44ca8d29515ec170210d, entries=7, sequenceid=18, filesize=5.2 K 2023-07-22 22:08:53,729 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/.tmp/rep_barrier/8d6f3884f7324905aa49585c9377089f 2023-07-22 22:08:53,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 034a80e600f0b0a59826ec1f748ad64f in 59ms, sequenceid=18, compaction requested=false 2023-07-22 22:08:53,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d6f3884f7324905aa49585c9377089f 2023-07-22 22:08:53,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/acl/034a80e600f0b0a59826ec1f748ad64f/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-22 22:08:53,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:53,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f. 2023-07-22 22:08:53,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 034a80e600f0b0a59826ec1f748ad64f: 2023-07-22 22:08:53,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690063576442.034a80e600f0b0a59826ec1f748ad64f. 2023-07-22 22:08:53,748 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/.tmp/table/e25cd44575d9404a87daf29488708051 2023-07-22 22:08:53,752 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e25cd44575d9404a87daf29488708051 2023-07-22 22:08:53,753 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/.tmp/info/ad0b4c78a51f4ab483177ea36f958de3 as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/info/ad0b4c78a51f4ab483177ea36f958de3 2023-07-22 22:08:53,758 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ad0b4c78a51f4ab483177ea36f958de3 2023-07-22 22:08:53,758 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/info/ad0b4c78a51f4ab483177ea36f958de3, entries=48, sequenceid=131, filesize=10.3 K 2023-07-22 22:08:53,759 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/.tmp/rep_barrier/8d6f3884f7324905aa49585c9377089f as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/rep_barrier/8d6f3884f7324905aa49585c9377089f 2023-07-22 22:08:53,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d6f3884f7324905aa49585c9377089f 2023-07-22 22:08:53,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/rep_barrier/8d6f3884f7324905aa49585c9377089f, entries=13, sequenceid=131, filesize=6.4 K 2023-07-22 22:08:53,767 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/.tmp/table/e25cd44575d9404a87daf29488708051 as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/table/e25cd44575d9404a87daf29488708051 2023-07-22 22:08:53,771 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e25cd44575d9404a87daf29488708051 2023-07-22 22:08:53,771 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/table/e25cd44575d9404a87daf29488708051, entries=24, sequenceid=131, filesize=6.9 K 2023-07-22 22:08:53,772 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 96ms, sequenceid=131, compaction requested=false 2023-07-22 22:08:53,786 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-22 22:08:53,787 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:53,787 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-22 22:08:53,788 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-22 22:08:53,788 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-22 22:08:53,788 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-22 22:08:53,818 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:53,818 INFO [RS:0;jenkins-hbase4:38207] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38207,1690063572104; zookeeper connection closed. 2023-07-22 22:08:53,818 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:38207-0x1018f1205d20001, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:53,818 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3b4ae7cc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3b4ae7cc 2023-07-22 22:08:53,875 INFO [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36573,1690063572179; all regions closed. 2023-07-22 22:08:53,875 DEBUG [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(1504): Waiting on c8b5ff07971d42c84313908b84ff2b6a 2023-07-22 22:08:53,880 DEBUG [RS:1;jenkins-hbase4:36573] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/oldWALs 2023-07-22 22:08:53,880 INFO [RS:1;jenkins-hbase4:36573] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36573%2C1690063572179:(num 1690063574882) 2023-07-22 22:08:53,880 DEBUG [RS:1;jenkins-hbase4:36573] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:53,880 INFO [RS:1;jenkins-hbase4:36573] regionserver.LeaseManager(133): Closed leases 2023-07-22 22:08:53,880 INFO [RS:1;jenkins-hbase4:36573] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-22 22:08:53,881 INFO [RS:1;jenkins-hbase4:36573] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 22:08:53,881 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 22:08:53,881 INFO [RS:1;jenkins-hbase4:36573] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 22:08:53,881 INFO [RS:1;jenkins-hbase4:36573] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 22:08:53,882 INFO [RS:1;jenkins-hbase4:36573] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36573 2023-07-22 22:08:53,883 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:53,883 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36573,1690063572179 2023-07-22 22:08:53,883 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:08:53,885 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36573,1690063572179] 2023-07-22 22:08:53,885 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36573,1690063572179; numProcessing=2 2023-07-22 22:08:53,886 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36573,1690063572179 already deleted, retry=false 2023-07-22 22:08:53,886 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36573,1690063572179 expired; onlineServers=1 2023-07-22 22:08:53,985 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:53,985 INFO [RS:1;jenkins-hbase4:36573] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36573,1690063572179; zookeeper connection closed. 2023-07-22 22:08:53,985 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:36573-0x1018f1205d20002, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:53,986 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5d797d6c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5d797d6c 2023-07-22 22:08:54,075 DEBUG [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(1504): Waiting on c8b5ff07971d42c84313908b84ff2b6a 2023-07-22 22:08:54,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/namespace/c8b5ff07971d42c84313908b84ff2b6a/.tmp/info/15c98aec8fb14fe1a4b35cf2d23a9722 2023-07-22 22:08:54,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/namespace/c8b5ff07971d42c84313908b84ff2b6a/.tmp/info/15c98aec8fb14fe1a4b35cf2d23a9722 as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/namespace/c8b5ff07971d42c84313908b84ff2b6a/info/15c98aec8fb14fe1a4b35cf2d23a9722 2023-07-22 22:08:54,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/namespace/c8b5ff07971d42c84313908b84ff2b6a/info/15c98aec8fb14fe1a4b35cf2d23a9722, entries=2, sequenceid=6, filesize=4.8 K 2023-07-22 22:08:54,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c8b5ff07971d42c84313908b84ff2b6a in 448ms, sequenceid=6, compaction requested=false 2023-07-22 22:08:54,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/data/hbase/namespace/c8b5ff07971d42c84313908b84ff2b6a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 22:08:54,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 22:08:54,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a. 2023-07-22 22:08:54,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c8b5ff07971d42c84313908b84ff2b6a: 2023-07-22 22:08:54,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690063575563.c8b5ff07971d42c84313908b84ff2b6a. 2023-07-22 22:08:54,276 INFO [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34749,1690063572232; all regions closed. 2023-07-22 22:08:54,282 DEBUG [RS:2;jenkins-hbase4:34749] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/oldWALs 2023-07-22 22:08:54,282 INFO [RS:2;jenkins-hbase4:34749] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34749%2C1690063572232.meta:.meta(num 1690063575206) 2023-07-22 22:08:54,287 DEBUG [RS:2;jenkins-hbase4:34749] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/oldWALs 2023-07-22 22:08:54,287 INFO [RS:2;jenkins-hbase4:34749] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34749%2C1690063572232:(num 1690063574871) 2023-07-22 22:08:54,287 DEBUG [RS:2;jenkins-hbase4:34749] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:54,287 INFO [RS:2;jenkins-hbase4:34749] regionserver.LeaseManager(133): Closed leases 2023-07-22 22:08:54,287 INFO [RS:2;jenkins-hbase4:34749] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-22 22:08:54,287 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 22:08:54,288 INFO [RS:2;jenkins-hbase4:34749] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34749 2023-07-22 22:08:54,290 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 22:08:54,290 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34749,1690063572232 2023-07-22 22:08:54,291 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34749,1690063572232] 2023-07-22 22:08:54,291 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34749,1690063572232; numProcessing=3 2023-07-22 22:08:54,293 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34749,1690063572232 already deleted, retry=false 2023-07-22 22:08:54,293 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34749,1690063572232 expired; onlineServers=0 2023-07-22 22:08:54,293 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33185,1690063570571' ***** 2023-07-22 22:08:54,293 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-22 22:08:54,293 DEBUG [M:0;jenkins-hbase4:33185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@194513aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 22:08:54,293 INFO [M:0;jenkins-hbase4:33185] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33185,1690063570571 2023-07-22 22:08:54,293 INFO [M:0;jenkins-hbase4:33185] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33185,1690063570571; all regions closed. 2023-07-22 22:08:54,293 DEBUG [M:0;jenkins-hbase4:33185] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 22:08:54,293 DEBUG [M:0;jenkins-hbase4:33185] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-22 22:08:54,293 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-22 22:08:54,293 DEBUG [M:0;jenkins-hbase4:33185] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-22 22:08:54,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690063574414] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690063574414,5,FailOnTimeoutGroup] 2023-07-22 22:08:54,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690063574414] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690063574414,5,FailOnTimeoutGroup] 2023-07-22 22:08:54,294 INFO [M:0;jenkins-hbase4:33185] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-22 22:08:54,294 INFO [M:0;jenkins-hbase4:33185] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-22 22:08:54,294 INFO [M:0;jenkins-hbase4:33185] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-22 22:08:54,294 DEBUG [M:0;jenkins-hbase4:33185] master.HMaster(1512): Stopping service threads 2023-07-22 22:08:54,294 INFO [M:0;jenkins-hbase4:33185] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-22 22:08:54,294 ERROR [M:0;jenkins-hbase4:33185] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-22 22:08:54,294 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-22 22:08:54,294 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 22:08:54,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 22:08:54,295 INFO [M:0;jenkins-hbase4:33185] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-22 22:08:54,295 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-22 22:08:54,295 DEBUG [M:0;jenkins-hbase4:33185] zookeeper.ZKUtil(398): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-22 22:08:54,295 WARN [M:0;jenkins-hbase4:33185] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-22 22:08:54,295 INFO [M:0;jenkins-hbase4:33185] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-22 22:08:54,296 INFO [M:0;jenkins-hbase4:33185] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-22 22:08:54,296 DEBUG [M:0;jenkins-hbase4:33185] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-22 22:08:54,296 INFO [M:0;jenkins-hbase4:33185] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:08:54,296 DEBUG [M:0;jenkins-hbase4:33185] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:08:54,296 DEBUG [M:0;jenkins-hbase4:33185] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-22 22:08:54,296 DEBUG [M:0;jenkins-hbase4:33185] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:08:54,296 INFO [M:0;jenkins-hbase4:33185] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.09 KB heapSize=449.34 KB 2023-07-22 22:08:54,313 INFO [M:0;jenkins-hbase4:33185] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.09 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a894b21790af45a1bd70f193603313cf 2023-07-22 22:08:54,318 INFO [M:0;jenkins-hbase4:33185] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a894b21790af45a1bd70f193603313cf 2023-07-22 22:08:54,319 DEBUG [M:0;jenkins-hbase4:33185] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a894b21790af45a1bd70f193603313cf as hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a894b21790af45a1bd70f193603313cf 2023-07-22 22:08:54,327 INFO [M:0;jenkins-hbase4:33185] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a894b21790af45a1bd70f193603313cf 2023-07-22 22:08:54,327 INFO [M:0;jenkins-hbase4:33185] regionserver.HStore(1080): Added hdfs://localhost:37905/user/jenkins/test-data/1d26fcd5-0642-3f34-a0c8-9d7054f645c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a894b21790af45a1bd70f193603313cf, entries=119, sequenceid=899, filesize=28.4 K 2023-07-22 22:08:54,328 INFO [M:0;jenkins-hbase4:33185] regionserver.HRegion(2948): Finished flush of dataSize ~373.09 KB/382047, heapSize ~449.33 KB/460112, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=899, compaction requested=false 2023-07-22 22:08:54,329 INFO [M:0;jenkins-hbase4:33185] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 22:08:54,329 DEBUG [M:0;jenkins-hbase4:33185] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 22:08:54,338 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 22:08:54,338 INFO [M:0;jenkins-hbase4:33185] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-22 22:08:54,339 INFO [M:0;jenkins-hbase4:33185] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33185 2023-07-22 22:08:54,344 DEBUG [M:0;jenkins-hbase4:33185] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33185,1690063570571 already deleted, retry=false 2023-07-22 22:08:54,392 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:54,392 INFO [RS:2;jenkins-hbase4:34749] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34749,1690063572232; zookeeper connection closed. 2023-07-22 22:08:54,392 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): regionserver:34749-0x1018f1205d20003, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:54,393 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@44232161] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@44232161 2023-07-22 22:08:54,393 INFO [Listener at jenkins-hbase4.apache.org/35991] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-22 22:08:54,493 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:54,493 DEBUG [Listener at localhost/34823-EventThread] zookeeper.ZKWatcher(600): master:33185-0x1018f1205d20000, quorum=127.0.0.1:64066, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 22:08:54,493 INFO [M:0;jenkins-hbase4:33185] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33185,1690063570571; zookeeper connection closed. 2023-07-22 22:08:54,495 WARN [Listener at jenkins-hbase4.apache.org/35991] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 22:08:54,499 INFO [Listener at jenkins-hbase4.apache.org/35991] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 22:08:54,602 WARN [BP-2038813737-172.31.14.131-1690063566396 heartbeating to localhost/127.0.0.1:37905] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 22:08:54,603 WARN [BP-2038813737-172.31.14.131-1690063566396 heartbeating to localhost/127.0.0.1:37905] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2038813737-172.31.14.131-1690063566396 (Datanode Uuid 1d9eb9cd-fa14-46b3-b94e-0261e6fd1e66) service to localhost/127.0.0.1:37905 2023-07-22 22:08:54,604 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622/dfs/data/data5/current/BP-2038813737-172.31.14.131-1690063566396] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 22:08:54,630 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622/dfs/data/data6/current/BP-2038813737-172.31.14.131-1690063566396] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 22:08:54,633 WARN [Listener at jenkins-hbase4.apache.org/35991] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 22:08:54,640 INFO [Listener at jenkins-hbase4.apache.org/35991] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 22:08:54,644 WARN [BP-2038813737-172.31.14.131-1690063566396 heartbeating to localhost/127.0.0.1:37905] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 22:08:54,644 WARN [BP-2038813737-172.31.14.131-1690063566396 heartbeating to localhost/127.0.0.1:37905] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2038813737-172.31.14.131-1690063566396 (Datanode Uuid 87b7aec1-b2d0-4be5-9bcf-9ed6f51b96f9) service to localhost/127.0.0.1:37905 2023-07-22 22:08:54,645 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622/dfs/data/data3/current/BP-2038813737-172.31.14.131-1690063566396] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 22:08:54,645 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622/dfs/data/data4/current/BP-2038813737-172.31.14.131-1690063566396] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 22:08:54,647 WARN [Listener at jenkins-hbase4.apache.org/35991] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 22:08:54,652 INFO [Listener at jenkins-hbase4.apache.org/35991] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 22:08:54,755 WARN [BP-2038813737-172.31.14.131-1690063566396 heartbeating to localhost/127.0.0.1:37905] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 22:08:54,755 WARN [BP-2038813737-172.31.14.131-1690063566396 heartbeating to localhost/127.0.0.1:37905] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2038813737-172.31.14.131-1690063566396 (Datanode Uuid df5246b2-6ce8-4e35-84e7-e3ae84d67eed) service to localhost/127.0.0.1:37905 2023-07-22 22:08:54,756 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622/dfs/data/data1/current/BP-2038813737-172.31.14.131-1690063566396] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 22:08:54,756 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0671854b-b527-7e21-a058-a73d068314e1/cluster_1db15050-954d-81ca-e776-e253bc4c8622/dfs/data/data2/current/BP-2038813737-172.31.14.131-1690063566396] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 22:08:54,778 INFO [Listener at jenkins-hbase4.apache.org/35991] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 22:08:54,914 INFO [Listener at jenkins-hbase4.apache.org/35991] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-22 22:08:55,014 INFO [Listener at jenkins-hbase4.apache.org/35991] hbase.HBaseTestingUtility(1293): Minicluster is down