2023-07-12 16:14:11,652 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-12 16:14:11,919 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc 2023-07-12 16:14:11,920 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-12 16:14:11,963 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 16:14:12,261 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 16:14:12,261 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c, deleteOnExit=true 2023-07-12 16:14:12,262 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 16:14:12,262 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/test.cache.data in system properties and HBase conf 2023-07-12 16:14:12,263 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 16:14:12,263 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop.log.dir in system properties and HBase conf 2023-07-12 16:14:12,264 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 16:14:12,264 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 16:14:12,265 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 16:14:12,667 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 16:14:12,674 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 16:14:12,675 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 16:14:12,675 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 16:14:12,676 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 16:14:12,676 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 16:14:12,677 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 16:14:12,677 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 16:14:12,678 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 16:14:12,678 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 16:14:12,678 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/nfs.dump.dir in system properties and HBase conf 2023-07-12 16:14:12,679 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/java.io.tmpdir in system properties and HBase conf 2023-07-12 16:14:12,679 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 16:14:12,680 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 16:14:12,680 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 16:14:13,320 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 16:14:13,327 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 16:14:13,705 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 16:14:13,917 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 16:14:13,935 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:13,977 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:14,023 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/java.io.tmpdir/Jetty_localhost_35507_hdfs____.dmpwxo/webapp 2023-07-12 16:14:14,208 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35507 2023-07-12 16:14:14,249 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 16:14:14,250 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 16:14:14,793 WARN [Listener at localhost/39241] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 16:14:14,923 WARN [Listener at localhost/39241] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 16:14:14,946 WARN [Listener at localhost/39241] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:14,955 INFO [Listener at localhost/39241] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:14,964 INFO [Listener at localhost/39241] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/java.io.tmpdir/Jetty_localhost_38221_datanode____mj6gyb/webapp 2023-07-12 16:14:15,107 INFO [Listener at localhost/39241] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38221 2023-07-12 16:14:15,714 WARN [Listener at localhost/33977] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 16:14:15,764 WARN [Listener at localhost/33977] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 16:14:15,771 WARN [Listener at localhost/33977] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:15,773 INFO [Listener at localhost/33977] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:15,810 INFO [Listener at localhost/33977] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/java.io.tmpdir/Jetty_localhost_46745_datanode____89nj19/webapp 2023-07-12 16:14:15,943 INFO [Listener at localhost/33977] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46745 2023-07-12 16:14:15,967 WARN [Listener at localhost/36341] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 16:14:16,034 WARN [Listener at localhost/36341] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 16:14:16,039 WARN [Listener at localhost/36341] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:16,041 INFO [Listener at localhost/36341] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:16,052 INFO [Listener at localhost/36341] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/java.io.tmpdir/Jetty_localhost_46403_datanode____.ndnvok/webapp 2023-07-12 16:14:16,207 INFO [Listener at localhost/36341] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46403 2023-07-12 16:14:16,235 WARN [Listener at localhost/37637] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 16:14:16,546 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9d7a17388e3628fb: Processing first storage report for DS-76f91b4a-8b95-40d5-bc90-a789a715da81 from datanode f9f444ec-733f-47d3-88dd-59b4986a3310 2023-07-12 16:14:16,547 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9d7a17388e3628fb: from storage DS-76f91b4a-8b95-40d5-bc90-a789a715da81 node DatanodeRegistration(127.0.0.1:46781, datanodeUuid=f9f444ec-733f-47d3-88dd-59b4986a3310, infoPort=36547, infoSecurePort=0, ipcPort=33977, storageInfo=lv=-57;cid=testClusterID;nsid=513670142;c=1689178453430), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-12 16:14:16,548 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8315b2668db2d6e0: Processing first storage report for DS-ad73f661-3989-41ab-879f-5829e537f64b from datanode ff502665-fccd-46ec-b9f3-67dac56c5d35 2023-07-12 16:14:16,548 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8315b2668db2d6e0: from storage DS-ad73f661-3989-41ab-879f-5829e537f64b node DatanodeRegistration(127.0.0.1:35133, datanodeUuid=ff502665-fccd-46ec-b9f3-67dac56c5d35, infoPort=39177, infoSecurePort=0, ipcPort=36341, storageInfo=lv=-57;cid=testClusterID;nsid=513670142;c=1689178453430), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 16:14:16,548 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbcf1963eafcbc25c: Processing first storage report for DS-c709f5e5-4049-4693-91af-c5991c46c813 from datanode d09e3a63-61f6-4fcd-81aa-3becf42ac74e 2023-07-12 16:14:16,548 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbcf1963eafcbc25c: from storage DS-c709f5e5-4049-4693-91af-c5991c46c813 node DatanodeRegistration(127.0.0.1:34625, datanodeUuid=d09e3a63-61f6-4fcd-81aa-3becf42ac74e, infoPort=34085, infoSecurePort=0, ipcPort=37637, storageInfo=lv=-57;cid=testClusterID;nsid=513670142;c=1689178453430), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 16:14:16,549 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9d7a17388e3628fb: Processing first storage report for DS-15a23b74-9047-414a-961d-56c6319ee3dd from datanode f9f444ec-733f-47d3-88dd-59b4986a3310 2023-07-12 16:14:16,549 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9d7a17388e3628fb: from storage DS-15a23b74-9047-414a-961d-56c6319ee3dd node DatanodeRegistration(127.0.0.1:46781, datanodeUuid=f9f444ec-733f-47d3-88dd-59b4986a3310, infoPort=36547, infoSecurePort=0, ipcPort=33977, storageInfo=lv=-57;cid=testClusterID;nsid=513670142;c=1689178453430), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 16:14:16,549 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8315b2668db2d6e0: Processing first storage report for DS-61acd7b3-39fd-4755-83ec-7b210031bb30 from datanode ff502665-fccd-46ec-b9f3-67dac56c5d35 2023-07-12 16:14:16,549 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8315b2668db2d6e0: from storage DS-61acd7b3-39fd-4755-83ec-7b210031bb30 node DatanodeRegistration(127.0.0.1:35133, datanodeUuid=ff502665-fccd-46ec-b9f3-67dac56c5d35, infoPort=39177, infoSecurePort=0, ipcPort=36341, storageInfo=lv=-57;cid=testClusterID;nsid=513670142;c=1689178453430), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 16:14:16,549 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbcf1963eafcbc25c: Processing first storage report for DS-232acf78-b443-45e6-bcbd-83214d3af9e3 from datanode d09e3a63-61f6-4fcd-81aa-3becf42ac74e 2023-07-12 16:14:16,550 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbcf1963eafcbc25c: from storage DS-232acf78-b443-45e6-bcbd-83214d3af9e3 node DatanodeRegistration(127.0.0.1:34625, datanodeUuid=d09e3a63-61f6-4fcd-81aa-3becf42ac74e, infoPort=34085, infoSecurePort=0, ipcPort=37637, storageInfo=lv=-57;cid=testClusterID;nsid=513670142;c=1689178453430), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 16:14:16,810 DEBUG [Listener at localhost/37637] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc 2023-07-12 16:14:16,914 INFO [Listener at localhost/37637] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c/zookeeper_0, clientPort=62419, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 16:14:16,939 INFO [Listener at localhost/37637] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62419 2023-07-12 16:14:16,951 INFO [Listener at localhost/37637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:16,954 INFO [Listener at localhost/37637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:17,662 INFO [Listener at localhost/37637] util.FSUtils(471): Created version file at hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca with version=8 2023-07-12 16:14:17,662 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/hbase-staging 2023-07-12 16:14:18,031 INFO [Listener at localhost/37637] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 16:14:18,606 INFO [Listener at localhost/37637] client.ConnectionUtils(127): master/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 16:14:18,640 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:18,640 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:18,640 INFO [Listener at localhost/37637] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 16:14:18,641 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:18,641 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 16:14:18,801 INFO [Listener at localhost/37637] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 16:14:18,880 DEBUG [Listener at localhost/37637] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 16:14:18,981 INFO [Listener at localhost/37637] ipc.NettyRpcServer(120): Bind to /172.31.10.131:41835 2023-07-12 16:14:19,001 INFO [Listener at localhost/37637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,004 INFO [Listener at localhost/37637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,037 INFO [Listener at localhost/37637] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41835 connecting to ZooKeeper ensemble=127.0.0.1:62419 2023-07-12 16:14:19,131 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:418350x0, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 16:14:19,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41835-0x101c5ec8d8c0000 connected 2023-07-12 16:14:19,203 DEBUG [Listener at localhost/37637] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 16:14:19,204 DEBUG [Listener at localhost/37637] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:14:19,219 DEBUG [Listener at localhost/37637] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 16:14:19,234 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41835 2023-07-12 16:14:19,234 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41835 2023-07-12 16:14:19,235 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41835 2023-07-12 16:14:19,239 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41835 2023-07-12 16:14:19,239 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41835 2023-07-12 16:14:19,247 INFO [Listener at localhost/37637] master.HMaster(444): hbase.rootdir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca, hbase.cluster.distributed=false 2023-07-12 16:14:19,340 INFO [Listener at localhost/37637] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 16:14:19,340 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,340 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,340 INFO [Listener at localhost/37637] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 16:14:19,341 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,341 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 16:14:19,347 INFO [Listener at localhost/37637] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 16:14:19,355 INFO [Listener at localhost/37637] ipc.NettyRpcServer(120): Bind to /172.31.10.131:45885 2023-07-12 16:14:19,359 INFO [Listener at localhost/37637] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 16:14:19,367 DEBUG [Listener at localhost/37637] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 16:14:19,368 INFO [Listener at localhost/37637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,370 INFO [Listener at localhost/37637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,372 INFO [Listener at localhost/37637] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45885 connecting to ZooKeeper ensemble=127.0.0.1:62419 2023-07-12 16:14:19,379 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:458850x0, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 16:14:19,380 DEBUG [Listener at localhost/37637] zookeeper.ZKUtil(164): regionserver:458850x0, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 16:14:19,384 DEBUG [Listener at localhost/37637] zookeeper.ZKUtil(164): regionserver:458850x0, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:14:19,384 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45885-0x101c5ec8d8c0001 connected 2023-07-12 16:14:19,385 DEBUG [Listener at localhost/37637] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 16:14:19,389 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45885 2023-07-12 16:14:19,389 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45885 2023-07-12 16:14:19,390 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45885 2023-07-12 16:14:19,392 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45885 2023-07-12 16:14:19,395 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45885 2023-07-12 16:14:19,409 INFO [Listener at localhost/37637] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 16:14:19,409 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,410 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,410 INFO [Listener at localhost/37637] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 16:14:19,410 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,410 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 16:14:19,411 INFO [Listener at localhost/37637] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 16:14:19,412 INFO [Listener at localhost/37637] ipc.NettyRpcServer(120): Bind to /172.31.10.131:36809 2023-07-12 16:14:19,413 INFO [Listener at localhost/37637] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 16:14:19,416 DEBUG [Listener at localhost/37637] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 16:14:19,417 INFO [Listener at localhost/37637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,421 INFO [Listener at localhost/37637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,424 INFO [Listener at localhost/37637] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36809 connecting to ZooKeeper ensemble=127.0.0.1:62419 2023-07-12 16:14:19,430 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:368090x0, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 16:14:19,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36809-0x101c5ec8d8c0002 connected 2023-07-12 16:14:19,433 DEBUG [Listener at localhost/37637] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 16:14:19,434 DEBUG [Listener at localhost/37637] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:14:19,440 DEBUG [Listener at localhost/37637] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 16:14:19,442 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36809 2023-07-12 16:14:19,442 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36809 2023-07-12 16:14:19,442 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36809 2023-07-12 16:14:19,447 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36809 2023-07-12 16:14:19,447 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36809 2023-07-12 16:14:19,460 INFO [Listener at localhost/37637] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 16:14:19,460 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,461 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,461 INFO [Listener at localhost/37637] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 16:14:19,461 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,461 INFO [Listener at localhost/37637] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 16:14:19,461 INFO [Listener at localhost/37637] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 16:14:19,462 INFO [Listener at localhost/37637] ipc.NettyRpcServer(120): Bind to /172.31.10.131:38727 2023-07-12 16:14:19,463 INFO [Listener at localhost/37637] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 16:14:19,464 DEBUG [Listener at localhost/37637] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 16:14:19,465 INFO [Listener at localhost/37637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,467 INFO [Listener at localhost/37637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,468 INFO [Listener at localhost/37637] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38727 connecting to ZooKeeper ensemble=127.0.0.1:62419 2023-07-12 16:14:19,473 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:387270x0, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 16:14:19,474 DEBUG [Listener at localhost/37637] zookeeper.ZKUtil(164): regionserver:387270x0, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 16:14:19,475 DEBUG [Listener at localhost/37637] zookeeper.ZKUtil(164): regionserver:387270x0, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:14:19,478 DEBUG [Listener at localhost/37637] zookeeper.ZKUtil(164): regionserver:387270x0, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 16:14:19,483 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38727-0x101c5ec8d8c0003 connected 2023-07-12 16:14:19,487 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38727 2023-07-12 16:14:19,491 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38727 2023-07-12 16:14:19,494 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38727 2023-07-12 16:14:19,495 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38727 2023-07-12 16:14:19,495 DEBUG [Listener at localhost/37637] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38727 2023-07-12 16:14:19,503 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase5.apache.org,41835,1689178457829 2023-07-12 16:14:19,516 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 16:14:19,518 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase5.apache.org,41835,1689178457829 2023-07-12 16:14:19,542 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 16:14:19,542 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 16:14:19,542 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 16:14:19,542 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 16:14:19,542 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:19,544 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 16:14:19,547 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase5.apache.org,41835,1689178457829 from backup master directory 2023-07-12 16:14:19,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 16:14:19,551 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase5.apache.org,41835,1689178457829 2023-07-12 16:14:19,551 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 16:14:19,552 WARN [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 16:14:19,552 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase5.apache.org,41835,1689178457829 2023-07-12 16:14:19,555 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 16:14:19,557 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 16:14:19,697 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/hbase.id with ID: 7a61622c-f2e6-4b2a-8495-b0d65f4a57e0 2023-07-12 16:14:19,752 INFO [master/jenkins-hbase5:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,775 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:19,856 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5f84de9f to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:19,894 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e974c2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:19,919 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 16:14:19,921 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 16:14:19,939 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 16:14:19,939 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 16:14:19,941 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 16:14:19,947 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 16:14:19,949 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 16:14:19,999 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/MasterData/data/master/store-tmp 2023-07-12 16:14:20,050 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:20,051 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 16:14:20,051 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:14:20,051 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:14:20,051 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 16:14:20,051 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:14:20,051 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:14:20,051 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 16:14:20,053 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/MasterData/WALs/jenkins-hbase5.apache.org,41835,1689178457829 2023-07-12 16:14:20,082 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C41835%2C1689178457829, suffix=, logDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/MasterData/WALs/jenkins-hbase5.apache.org,41835,1689178457829, archiveDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/MasterData/oldWALs, maxLogs=10 2023-07-12 16:14:20,157 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34625,DS-c709f5e5-4049-4693-91af-c5991c46c813,DISK] 2023-07-12 16:14:20,157 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35133,DS-ad73f661-3989-41ab-879f-5829e537f64b,DISK] 2023-07-12 16:14:20,157 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46781,DS-76f91b4a-8b95-40d5-bc90-a789a715da81,DISK] 2023-07-12 16:14:20,180 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 16:14:20,266 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/MasterData/WALs/jenkins-hbase5.apache.org,41835,1689178457829/jenkins-hbase5.apache.org%2C41835%2C1689178457829.1689178460096 2023-07-12 16:14:20,267 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35133,DS-ad73f661-3989-41ab-879f-5829e537f64b,DISK], DatanodeInfoWithStorage[127.0.0.1:34625,DS-c709f5e5-4049-4693-91af-c5991c46c813,DISK], DatanodeInfoWithStorage[127.0.0.1:46781,DS-76f91b4a-8b95-40d5-bc90-a789a715da81,DISK]] 2023-07-12 16:14:20,268 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 16:14:20,268 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:20,272 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 16:14:20,273 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 16:14:20,366 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 16:14:20,378 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 16:14:20,411 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 16:14:20,426 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:20,435 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 16:14:20,437 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 16:14:20,454 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 16:14:20,459 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:20,460 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67507029, jitterRate=0.005933120846748352}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:14:20,461 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 16:14:20,462 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 16:14:20,486 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 16:14:20,486 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 16:14:20,489 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 16:14:20,491 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 16:14:20,534 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 42 msec 2023-07-12 16:14:20,535 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 16:14:20,566 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 16:14:20,573 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 16:14:20,600 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 16:14:20,605 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 16:14:20,607 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 16:14:20,613 INFO [master/jenkins-hbase5:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 16:14:20,617 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 16:14:20,620 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:20,622 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 16:14:20,623 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 16:14:20,641 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 16:14:20,654 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 16:14:20,654 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 16:14:20,654 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 16:14:20,654 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 16:14:20,654 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:20,655 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase5.apache.org,41835,1689178457829, sessionid=0x101c5ec8d8c0000, setting cluster-up flag (Was=false) 2023-07-12 16:14:20,676 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:20,685 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 16:14:20,692 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,41835,1689178457829 2023-07-12 16:14:20,699 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:20,706 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 16:14:20,708 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,41835,1689178457829 2023-07-12 16:14:20,711 WARN [master/jenkins-hbase5:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp 2023-07-12 16:14:20,800 INFO [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer(951): ClusterId : 7a61622c-f2e6-4b2a-8495-b0d65f4a57e0 2023-07-12 16:14:20,800 INFO [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(951): ClusterId : 7a61622c-f2e6-4b2a-8495-b0d65f4a57e0 2023-07-12 16:14:20,814 INFO [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(951): ClusterId : 7a61622c-f2e6-4b2a-8495-b0d65f4a57e0 2023-07-12 16:14:20,833 DEBUG [RS:2;jenkins-hbase5:38727] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 16:14:20,834 DEBUG [RS:1;jenkins-hbase5:36809] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 16:14:20,833 DEBUG [RS:0;jenkins-hbase5:45885] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 16:14:20,841 DEBUG [RS:0;jenkins-hbase5:45885] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 16:14:20,841 DEBUG [RS:0;jenkins-hbase5:45885] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 16:14:20,842 DEBUG [RS:2;jenkins-hbase5:38727] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 16:14:20,842 DEBUG [RS:2;jenkins-hbase5:38727] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 16:14:20,843 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-12 16:14:20,846 DEBUG [RS:1;jenkins-hbase5:36809] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 16:14:20,846 DEBUG [RS:1;jenkins-hbase5:36809] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 16:14:20,849 INFO [master/jenkins-hbase5:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:20,849 DEBUG [RS:2;jenkins-hbase5:38727] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 16:14:20,849 DEBUG [RS:1;jenkins-hbase5:36809] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 16:14:20,850 INFO [master/jenkins-hbase5:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-12 16:14:20,850 DEBUG [RS:0;jenkins-hbase5:45885] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 16:14:20,850 DEBUG [RS:2;jenkins-hbase5:38727] zookeeper.ReadOnlyZKClient(139): Connect 0x06c5300a to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:20,856 DEBUG [RS:0;jenkins-hbase5:45885] zookeeper.ReadOnlyZKClient(139): Connect 0x7b29c64b to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:20,851 DEBUG [RS:1;jenkins-hbase5:36809] zookeeper.ReadOnlyZKClient(139): Connect 0x60eff91a to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:20,892 DEBUG [RS:1;jenkins-hbase5:36809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e280b77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:20,894 DEBUG [RS:1;jenkins-hbase5:36809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a17926a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 16:14:20,898 DEBUG [RS:2;jenkins-hbase5:38727] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@802cea2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:20,898 DEBUG [RS:2;jenkins-hbase5:38727] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c3d5b7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 16:14:20,900 DEBUG [RS:0;jenkins-hbase5:45885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75ee375e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:20,901 DEBUG [RS:0;jenkins-hbase5:45885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34d33d65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 16:14:20,924 DEBUG [RS:1;jenkins-hbase5:36809] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase5:36809 2023-07-12 16:14:20,925 DEBUG [RS:2;jenkins-hbase5:38727] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase5:38727 2023-07-12 16:14:20,925 DEBUG [RS:0;jenkins-hbase5:45885] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase5:45885 2023-07-12 16:14:20,932 INFO [RS:0;jenkins-hbase5:45885] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 16:14:20,932 INFO [RS:1;jenkins-hbase5:36809] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 16:14:20,932 INFO [RS:2;jenkins-hbase5:38727] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 16:14:20,939 INFO [RS:1;jenkins-hbase5:36809] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 16:14:20,939 INFO [RS:0;jenkins-hbase5:45885] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 16:14:20,941 DEBUG [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 16:14:20,941 INFO [RS:2;jenkins-hbase5:38727] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 16:14:20,941 DEBUG [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 16:14:20,943 DEBUG [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 16:14:20,943 INFO [RS:0;jenkins-hbase5:45885] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:20,943 DEBUG [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 16:14:20,942 INFO [RS:1;jenkins-hbase5:36809] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:20,943 INFO [RS:2;jenkins-hbase5:38727] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:20,943 DEBUG [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 16:14:20,944 DEBUG [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 16:14:20,947 INFO [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,41835,1689178457829 with isa=jenkins-hbase5.apache.org/172.31.10.131:45885, startcode=1689178459339 2023-07-12 16:14:20,947 INFO [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,41835,1689178457829 with isa=jenkins-hbase5.apache.org/172.31.10.131:36809, startcode=1689178459409 2023-07-12 16:14:20,948 INFO [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,41835,1689178457829 with isa=jenkins-hbase5.apache.org/172.31.10.131:38727, startcode=1689178459459 2023-07-12 16:14:20,972 DEBUG [RS:2;jenkins-hbase5:38727] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 16:14:20,975 DEBUG [RS:1;jenkins-hbase5:36809] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 16:14:20,976 DEBUG [RS:0;jenkins-hbase5:45885] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 16:14:21,002 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 16:14:21,068 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 16:14:21,068 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 16:14:21,069 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 16:14:21,069 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 16:14:21,069 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase5:0, corePoolSize=10, maxPoolSize=10 2023-07-12 16:14:21,069 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,069 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 16:14:21,069 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,072 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689178491072 2023-07-12 16:14:21,080 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 16:14:21,084 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 16:14:21,087 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 16:14:21,095 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 16:14:21,098 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 16:14:21,116 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 16:14:21,117 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:46377, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 16:14:21,117 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:32907, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 16:14:21,120 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 16:14:21,120 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:44075, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 16:14:21,126 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 16:14:21,126 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 16:14:21,131 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,136 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41835] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 16:14:21,139 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 16:14:21,144 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 16:14:21,144 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 16:14:21,151 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41835] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 16:14:21,152 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41835] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 16:14:21,179 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 16:14:21,180 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 16:14:21,184 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689178461182,5,FailOnTimeoutGroup] 2023-07-12 16:14:21,188 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689178461184,5,FailOnTimeoutGroup] 2023-07-12 16:14:21,188 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,191 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 16:14:21,194 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,194 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,220 DEBUG [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 16:14:21,220 DEBUG [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 16:14:21,220 WARN [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 16:14:21,220 DEBUG [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 16:14:21,220 WARN [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 16:14:21,221 WARN [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 16:14:21,233 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 16:14:21,234 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 16:14:21,235 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:14:21,272 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:21,275 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 16:14:21,280 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/info 2023-07-12 16:14:21,281 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 16:14:21,282 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:21,282 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 16:14:21,285 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/rep_barrier 2023-07-12 16:14:21,286 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 16:14:21,286 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:21,287 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 16:14:21,289 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/table 2023-07-12 16:14:21,290 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 16:14:21,291 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:21,293 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740 2023-07-12 16:14:21,294 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740 2023-07-12 16:14:21,299 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 16:14:21,302 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 16:14:21,308 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:21,309 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60976480, jitterRate=-0.09137964248657227}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 16:14:21,309 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 16:14:21,310 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 16:14:21,310 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 16:14:21,310 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 16:14:21,310 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 16:14:21,310 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 16:14:21,312 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 16:14:21,312 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 16:14:21,323 INFO [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,41835,1689178457829 with isa=jenkins-hbase5.apache.org/172.31.10.131:36809, startcode=1689178459409 2023-07-12 16:14:21,323 INFO [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,41835,1689178457829 with isa=jenkins-hbase5.apache.org/172.31.10.131:38727, startcode=1689178459459 2023-07-12 16:14:21,324 INFO [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,41835,1689178457829 with isa=jenkins-hbase5.apache.org/172.31.10.131:45885, startcode=1689178459339 2023-07-12 16:14:21,324 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 16:14:21,324 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 16:14:21,331 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41835] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:21,339 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41835] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:21,340 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41835] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:21,347 DEBUG [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:14:21,347 DEBUG [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39241 2023-07-12 16:14:21,347 DEBUG [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 16:14:21,348 DEBUG [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:14:21,348 DEBUG [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39241 2023-07-12 16:14:21,348 DEBUG [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 16:14:21,348 DEBUG [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:14:21,348 DEBUG [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39241 2023-07-12 16:14:21,349 DEBUG [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 16:14:21,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 16:14:21,356 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 16:14:21,360 DEBUG [RS:2;jenkins-hbase5:38727] zookeeper.ZKUtil(162): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:21,360 WARN [RS:2;jenkins-hbase5:38727] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 16:14:21,360 DEBUG [RS:1;jenkins-hbase5:36809] zookeeper.ZKUtil(162): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:21,360 DEBUG [RS:0;jenkins-hbase5:45885] zookeeper.ZKUtil(162): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:21,361 WARN [RS:0;jenkins-hbase5:45885] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 16:14:21,360 INFO [RS:2;jenkins-hbase5:38727] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 16:14:21,361 INFO [RS:0;jenkins-hbase5:45885] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 16:14:21,362 DEBUG [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/WALs/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:21,362 DEBUG [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/WALs/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:21,363 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,38727,1689178459459] 2023-07-12 16:14:21,363 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,36809,1689178459409] 2023-07-12 16:14:21,363 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,45885,1689178459339] 2023-07-12 16:14:21,360 WARN [RS:1;jenkins-hbase5:36809] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 16:14:21,364 INFO [RS:1;jenkins-hbase5:36809] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 16:14:21,364 DEBUG [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/WALs/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:21,374 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 16:14:21,377 DEBUG [RS:1;jenkins-hbase5:36809] zookeeper.ZKUtil(162): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:21,377 DEBUG [RS:0;jenkins-hbase5:45885] zookeeper.ZKUtil(162): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:21,377 DEBUG [RS:2;jenkins-hbase5:38727] zookeeper.ZKUtil(162): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:21,378 DEBUG [RS:1;jenkins-hbase5:36809] zookeeper.ZKUtil(162): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:21,378 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 16:14:21,378 DEBUG [RS:2;jenkins-hbase5:38727] zookeeper.ZKUtil(162): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:21,378 DEBUG [RS:1;jenkins-hbase5:36809] zookeeper.ZKUtil(162): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:21,378 DEBUG [RS:2;jenkins-hbase5:38727] zookeeper.ZKUtil(162): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:21,379 DEBUG [RS:0;jenkins-hbase5:45885] zookeeper.ZKUtil(162): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:21,380 DEBUG [RS:0;jenkins-hbase5:45885] zookeeper.ZKUtil(162): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:21,392 DEBUG [RS:1;jenkins-hbase5:36809] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 16:14:21,392 DEBUG [RS:2;jenkins-hbase5:38727] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 16:14:21,392 DEBUG [RS:0;jenkins-hbase5:45885] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 16:14:21,406 INFO [RS:0;jenkins-hbase5:45885] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 16:14:21,407 INFO [RS:1;jenkins-hbase5:36809] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 16:14:21,406 INFO [RS:2;jenkins-hbase5:38727] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 16:14:21,439 INFO [RS:0;jenkins-hbase5:45885] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 16:14:21,440 INFO [RS:1;jenkins-hbase5:36809] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 16:14:21,439 INFO [RS:2;jenkins-hbase5:38727] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 16:14:21,446 INFO [RS:0;jenkins-hbase5:45885] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 16:14:21,447 INFO [RS:0;jenkins-hbase5:45885] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,447 INFO [RS:2;jenkins-hbase5:38727] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 16:14:21,448 INFO [RS:2;jenkins-hbase5:38727] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,457 INFO [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 16:14:21,459 INFO [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 16:14:21,460 INFO [RS:1;jenkins-hbase5:36809] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 16:14:21,460 INFO [RS:1;jenkins-hbase5:36809] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,471 INFO [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 16:14:21,473 INFO [RS:1;jenkins-hbase5:36809] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,473 INFO [RS:0;jenkins-hbase5:45885] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,473 INFO [RS:2;jenkins-hbase5:38727] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,473 DEBUG [RS:1;jenkins-hbase5:36809] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,473 DEBUG [RS:0;jenkins-hbase5:45885] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,474 DEBUG [RS:2;jenkins-hbase5:38727] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,474 DEBUG [RS:0;jenkins-hbase5:45885] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,474 DEBUG [RS:2;jenkins-hbase5:38727] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,474 DEBUG [RS:0;jenkins-hbase5:45885] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,474 DEBUG [RS:2;jenkins-hbase5:38727] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,474 DEBUG [RS:0;jenkins-hbase5:45885] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,474 DEBUG [RS:2;jenkins-hbase5:38727] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,474 DEBUG [RS:0;jenkins-hbase5:45885] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,474 DEBUG [RS:2;jenkins-hbase5:38727] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,474 DEBUG [RS:0;jenkins-hbase5:45885] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 16:14:21,474 DEBUG [RS:2;jenkins-hbase5:38727] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 16:14:21,474 DEBUG [RS:0;jenkins-hbase5:45885] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,474 DEBUG [RS:2;jenkins-hbase5:38727] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,474 DEBUG [RS:1;jenkins-hbase5:36809] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,474 DEBUG [RS:2;jenkins-hbase5:38727] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,474 DEBUG [RS:0;jenkins-hbase5:45885] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,475 DEBUG [RS:2;jenkins-hbase5:38727] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,475 DEBUG [RS:0;jenkins-hbase5:45885] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,475 DEBUG [RS:2;jenkins-hbase5:38727] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,475 DEBUG [RS:0;jenkins-hbase5:45885] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,475 DEBUG [RS:1;jenkins-hbase5:36809] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,475 DEBUG [RS:1;jenkins-hbase5:36809] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,475 DEBUG [RS:1;jenkins-hbase5:36809] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,475 DEBUG [RS:1;jenkins-hbase5:36809] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 16:14:21,475 DEBUG [RS:1;jenkins-hbase5:36809] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,475 DEBUG [RS:1;jenkins-hbase5:36809] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,476 DEBUG [RS:1;jenkins-hbase5:36809] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,476 DEBUG [RS:1;jenkins-hbase5:36809] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,487 INFO [RS:0;jenkins-hbase5:45885] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,487 INFO [RS:1;jenkins-hbase5:36809] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,487 INFO [RS:0;jenkins-hbase5:45885] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,487 INFO [RS:1;jenkins-hbase5:36809] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,488 INFO [RS:1;jenkins-hbase5:36809] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,488 INFO [RS:2;jenkins-hbase5:38727] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,488 INFO [RS:2;jenkins-hbase5:38727] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,488 INFO [RS:2;jenkins-hbase5:38727] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,487 INFO [RS:0;jenkins-hbase5:45885] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,509 INFO [RS:1;jenkins-hbase5:36809] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 16:14:21,512 INFO [RS:1;jenkins-hbase5:36809] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,36809,1689178459409-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,530 DEBUG [jenkins-hbase5:41835] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-12 16:14:21,536 DEBUG [jenkins-hbase5:41835] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:14:21,542 INFO [RS:2;jenkins-hbase5:38727] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 16:14:21,542 INFO [RS:2;jenkins-hbase5:38727] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,38727,1689178459459-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,527 INFO [RS:0;jenkins-hbase5:45885] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 16:14:21,545 INFO [RS:0;jenkins-hbase5:45885] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,45885,1689178459339-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,545 DEBUG [jenkins-hbase5:41835] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:14:21,545 DEBUG [jenkins-hbase5:41835] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:14:21,545 DEBUG [jenkins-hbase5:41835] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:14:21,545 DEBUG [jenkins-hbase5:41835] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:14:21,553 INFO [RS:1;jenkins-hbase5:36809] regionserver.Replication(203): jenkins-hbase5.apache.org,36809,1689178459409 started 2023-07-12 16:14:21,553 INFO [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,36809,1689178459409, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:36809, sessionid=0x101c5ec8d8c0002 2023-07-12 16:14:21,554 DEBUG [RS:1;jenkins-hbase5:36809] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 16:14:21,554 DEBUG [RS:1;jenkins-hbase5:36809] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:21,554 DEBUG [RS:1;jenkins-hbase5:36809] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,36809,1689178459409' 2023-07-12 16:14:21,554 DEBUG [RS:1;jenkins-hbase5:36809] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 16:14:21,555 DEBUG [RS:1;jenkins-hbase5:36809] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 16:14:21,556 DEBUG [RS:1;jenkins-hbase5:36809] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 16:14:21,556 DEBUG [RS:1;jenkins-hbase5:36809] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 16:14:21,556 DEBUG [RS:1;jenkins-hbase5:36809] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:21,556 DEBUG [RS:1;jenkins-hbase5:36809] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,36809,1689178459409' 2023-07-12 16:14:21,556 DEBUG [RS:1;jenkins-hbase5:36809] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:21,610 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,38727,1689178459459, state=OPENING 2023-07-12 16:14:21,624 INFO [RS:0;jenkins-hbase5:45885] regionserver.Replication(203): jenkins-hbase5.apache.org,45885,1689178459339 started 2023-07-12 16:14:21,624 INFO [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,45885,1689178459339, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:45885, sessionid=0x101c5ec8d8c0001 2023-07-12 16:14:21,624 DEBUG [RS:0;jenkins-hbase5:45885] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 16:14:21,628 DEBUG [RS:1;jenkins-hbase5:36809] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:21,624 DEBUG [RS:0;jenkins-hbase5:45885] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:21,628 DEBUG [RS:0;jenkins-hbase5:45885] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,45885,1689178459339' 2023-07-12 16:14:21,630 DEBUG [RS:0;jenkins-hbase5:45885] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 16:14:21,634 DEBUG [RS:1;jenkins-hbase5:36809] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 16:14:21,634 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 16:14:21,634 INFO [RS:1;jenkins-hbase5:36809] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 16:14:21,634 INFO [RS:1;jenkins-hbase5:36809] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 16:14:21,636 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:21,636 DEBUG [RS:0;jenkins-hbase5:45885] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 16:14:21,637 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 16:14:21,638 DEBUG [RS:0;jenkins-hbase5:45885] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 16:14:21,638 DEBUG [RS:0;jenkins-hbase5:45885] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 16:14:21,638 DEBUG [RS:0;jenkins-hbase5:45885] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:21,642 DEBUG [RS:0;jenkins-hbase5:45885] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,45885,1689178459339' 2023-07-12 16:14:21,642 DEBUG [RS:0;jenkins-hbase5:45885] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:21,643 DEBUG [RS:0;jenkins-hbase5:45885] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:21,643 DEBUG [RS:0;jenkins-hbase5:45885] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 16:14:21,643 INFO [RS:0;jenkins-hbase5:45885] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 16:14:21,664 INFO [RS:2;jenkins-hbase5:38727] regionserver.Replication(203): jenkins-hbase5.apache.org,38727,1689178459459 started 2023-07-12 16:14:21,664 INFO [RS:0;jenkins-hbase5:45885] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 16:14:21,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,38727,1689178459459}] 2023-07-12 16:14:21,665 INFO [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,38727,1689178459459, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:38727, sessionid=0x101c5ec8d8c0003 2023-07-12 16:14:21,665 DEBUG [RS:2;jenkins-hbase5:38727] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 16:14:21,665 DEBUG [RS:2;jenkins-hbase5:38727] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:21,665 DEBUG [RS:2;jenkins-hbase5:38727] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,38727,1689178459459' 2023-07-12 16:14:21,665 DEBUG [RS:2;jenkins-hbase5:38727] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 16:14:21,666 DEBUG [RS:2;jenkins-hbase5:38727] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 16:14:21,666 DEBUG [RS:2;jenkins-hbase5:38727] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 16:14:21,666 DEBUG [RS:2;jenkins-hbase5:38727] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 16:14:21,667 DEBUG [RS:2;jenkins-hbase5:38727] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:21,667 DEBUG [RS:2;jenkins-hbase5:38727] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,38727,1689178459459' 2023-07-12 16:14:21,667 DEBUG [RS:2;jenkins-hbase5:38727] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:21,667 DEBUG [RS:2;jenkins-hbase5:38727] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:21,668 DEBUG [RS:2;jenkins-hbase5:38727] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 16:14:21,668 INFO [RS:2;jenkins-hbase5:38727] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 16:14:21,668 INFO [RS:2;jenkins-hbase5:38727] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 16:14:21,748 INFO [RS:1;jenkins-hbase5:36809] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C36809%2C1689178459409, suffix=, logDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/WALs/jenkins-hbase5.apache.org,36809,1689178459409, archiveDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/oldWALs, maxLogs=32 2023-07-12 16:14:21,770 INFO [RS:0;jenkins-hbase5:45885] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C45885%2C1689178459339, suffix=, logDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/WALs/jenkins-hbase5.apache.org,45885,1689178459339, archiveDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/oldWALs, maxLogs=32 2023-07-12 16:14:21,774 INFO [RS:2;jenkins-hbase5:38727] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C38727%2C1689178459459, suffix=, logDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/WALs/jenkins-hbase5.apache.org,38727,1689178459459, archiveDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/oldWALs, maxLogs=32 2023-07-12 16:14:21,788 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34625,DS-c709f5e5-4049-4693-91af-c5991c46c813,DISK] 2023-07-12 16:14:21,789 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46781,DS-76f91b4a-8b95-40d5-bc90-a789a715da81,DISK] 2023-07-12 16:14:21,796 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35133,DS-ad73f661-3989-41ab-879f-5829e537f64b,DISK] 2023-07-12 16:14:21,803 INFO [RS:1;jenkins-hbase5:36809] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/WALs/jenkins-hbase5.apache.org,36809,1689178459409/jenkins-hbase5.apache.org%2C36809%2C1689178459409.1689178461750 2023-07-12 16:14:21,805 DEBUG [RS:1;jenkins-hbase5:36809] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34625,DS-c709f5e5-4049-4693-91af-c5991c46c813,DISK], DatanodeInfoWithStorage[127.0.0.1:46781,DS-76f91b4a-8b95-40d5-bc90-a789a715da81,DISK], DatanodeInfoWithStorage[127.0.0.1:35133,DS-ad73f661-3989-41ab-879f-5829e537f64b,DISK]] 2023-07-12 16:14:21,832 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46781,DS-76f91b4a-8b95-40d5-bc90-a789a715da81,DISK] 2023-07-12 16:14:21,832 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34625,DS-c709f5e5-4049-4693-91af-c5991c46c813,DISK] 2023-07-12 16:14:21,833 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35133,DS-ad73f661-3989-41ab-879f-5829e537f64b,DISK] 2023-07-12 16:14:21,854 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46781,DS-76f91b4a-8b95-40d5-bc90-a789a715da81,DISK] 2023-07-12 16:14:21,854 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35133,DS-ad73f661-3989-41ab-879f-5829e537f64b,DISK] 2023-07-12 16:14:21,854 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34625,DS-c709f5e5-4049-4693-91af-c5991c46c813,DISK] 2023-07-12 16:14:21,865 INFO [RS:2;jenkins-hbase5:38727] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/WALs/jenkins-hbase5.apache.org,38727,1689178459459/jenkins-hbase5.apache.org%2C38727%2C1689178459459.1689178461776 2023-07-12 16:14:21,883 DEBUG [RS:2;jenkins-hbase5:38727] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34625,DS-c709f5e5-4049-4693-91af-c5991c46c813,DISK], DatanodeInfoWithStorage[127.0.0.1:46781,DS-76f91b4a-8b95-40d5-bc90-a789a715da81,DISK], DatanodeInfoWithStorage[127.0.0.1:35133,DS-ad73f661-3989-41ab-879f-5829e537f64b,DISK]] 2023-07-12 16:14:21,883 INFO [RS:0;jenkins-hbase5:45885] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/WALs/jenkins-hbase5.apache.org,45885,1689178459339/jenkins-hbase5.apache.org%2C45885%2C1689178459339.1689178461776 2023-07-12 16:14:21,896 DEBUG [RS:0;jenkins-hbase5:45885] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34625,DS-c709f5e5-4049-4693-91af-c5991c46c813,DISK], DatanodeInfoWithStorage[127.0.0.1:35133,DS-ad73f661-3989-41ab-879f-5829e537f64b,DISK], DatanodeInfoWithStorage[127.0.0.1:46781,DS-76f91b4a-8b95-40d5-bc90-a789a715da81,DISK]] 2023-07-12 16:14:21,913 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:21,917 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 16:14:21,921 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:52252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 16:14:21,937 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 16:14:21,938 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 16:14:21,944 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C38727%2C1689178459459.meta, suffix=.meta, logDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/WALs/jenkins-hbase5.apache.org,38727,1689178459459, archiveDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/oldWALs, maxLogs=32 2023-07-12 16:14:21,971 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35133,DS-ad73f661-3989-41ab-879f-5829e537f64b,DISK] 2023-07-12 16:14:21,973 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34625,DS-c709f5e5-4049-4693-91af-c5991c46c813,DISK] 2023-07-12 16:14:21,974 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46781,DS-76f91b4a-8b95-40d5-bc90-a789a715da81,DISK] 2023-07-12 16:14:21,993 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/WALs/jenkins-hbase5.apache.org,38727,1689178459459/jenkins-hbase5.apache.org%2C38727%2C1689178459459.meta.1689178461946.meta 2023-07-12 16:14:21,995 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34625,DS-c709f5e5-4049-4693-91af-c5991c46c813,DISK], DatanodeInfoWithStorage[127.0.0.1:35133,DS-ad73f661-3989-41ab-879f-5829e537f64b,DISK], DatanodeInfoWithStorage[127.0.0.1:46781,DS-76f91b4a-8b95-40d5-bc90-a789a715da81,DISK]] 2023-07-12 16:14:21,995 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 16:14:21,997 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-12 16:14:21,999 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:22,001 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 16:14:22,005 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 16:14:22,007 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 16:14:22,022 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 16:14:22,022 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:22,022 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 16:14:22,022 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 16:14:22,028 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 16:14:22,031 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/info 2023-07-12 16:14:22,032 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/info 2023-07-12 16:14:22,033 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 16:14:22,034 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:22,035 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 16:14:22,037 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/rep_barrier 2023-07-12 16:14:22,037 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/rep_barrier 2023-07-12 16:14:22,037 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 16:14:22,039 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:22,039 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 16:14:22,040 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/table 2023-07-12 16:14:22,041 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/table 2023-07-12 16:14:22,041 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 16:14:22,042 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:22,045 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740 2023-07-12 16:14:22,049 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740 2023-07-12 16:14:22,053 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 16:14:22,055 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 16:14:22,058 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58932348, jitterRate=-0.12183958292007446}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 16:14:22,061 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 16:14:22,076 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689178461901 2023-07-12 16:14:22,113 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 16:14:22,114 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 16:14:22,116 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,38727,1689178459459, state=OPEN 2023-07-12 16:14:22,121 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 16:14:22,121 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 16:14:22,130 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 16:14:22,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,38727,1689178459459 in 475 msec 2023-07-12 16:14:22,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 16:14:22,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 784 msec 2023-07-12 16:14:22,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2830 sec 2023-07-12 16:14:22,152 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689178462152, completionTime=-1 2023-07-12 16:14:22,152 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-12 16:14:22,152 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 16:14:22,242 DEBUG [hconnection-0x5d1b248e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:22,245 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:52254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:22,271 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-12 16:14:22,271 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689178522271 2023-07-12 16:14:22,271 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689178582271 2023-07-12 16:14:22,271 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 118 msec 2023-07-12 16:14:22,303 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,41835,1689178457829-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:22,303 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,41835,1689178457829-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:22,303 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,41835,1689178457829-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:22,305 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase5:41835, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:22,306 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:22,313 DEBUG [master/jenkins-hbase5:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 16:14:22,343 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 16:14:22,345 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 16:14:22,358 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 16:14:22,361 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:14:22,365 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:14:22,391 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/hbase/namespace/541a55fdcb2553a5eba9afc162ecc7fd 2023-07-12 16:14:22,394 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/hbase/namespace/541a55fdcb2553a5eba9afc162ecc7fd empty. 2023-07-12 16:14:22,395 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/hbase/namespace/541a55fdcb2553a5eba9afc162ecc7fd 2023-07-12 16:14:22,395 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 16:14:22,446 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 16:14:22,448 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 541a55fdcb2553a5eba9afc162ecc7fd, NAME => 'hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:14:22,475 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:22,475 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 541a55fdcb2553a5eba9afc162ecc7fd, disabling compactions & flushes 2023-07-12 16:14:22,475 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd. 2023-07-12 16:14:22,475 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd. 2023-07-12 16:14:22,475 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd. after waiting 0 ms 2023-07-12 16:14:22,475 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd. 2023-07-12 16:14:22,475 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd. 2023-07-12 16:14:22,476 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 541a55fdcb2553a5eba9afc162ecc7fd: 2023-07-12 16:14:22,481 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:14:22,499 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689178462485"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178462485"}]},"ts":"1689178462485"} 2023-07-12 16:14:22,531 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 16:14:22,533 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:14:22,539 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178462533"}]},"ts":"1689178462533"} 2023-07-12 16:14:22,543 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 16:14:22,548 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:14:22,551 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:14:22,551 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:14:22,551 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:14:22,551 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:14:22,554 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=541a55fdcb2553a5eba9afc162ecc7fd, ASSIGN}] 2023-07-12 16:14:22,558 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=541a55fdcb2553a5eba9afc162ecc7fd, ASSIGN 2023-07-12 16:14:22,561 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=541a55fdcb2553a5eba9afc162ecc7fd, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,45885,1689178459339; forceNewPlan=false, retain=false 2023-07-12 16:14:22,716 INFO [jenkins-hbase5:41835] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 16:14:22,717 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=541a55fdcb2553a5eba9afc162ecc7fd, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:22,718 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689178462717"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178462717"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178462717"}]},"ts":"1689178462717"} 2023-07-12 16:14:22,727 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 541a55fdcb2553a5eba9afc162ecc7fd, server=jenkins-hbase5.apache.org,45885,1689178459339}] 2023-07-12 16:14:22,883 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:22,884 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 16:14:22,887 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47618, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 16:14:22,894 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd. 2023-07-12 16:14:22,894 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 541a55fdcb2553a5eba9afc162ecc7fd, NAME => 'hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd.', STARTKEY => '', ENDKEY => ''} 2023-07-12 16:14:22,895 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd. service=AccessControlService 2023-07-12 16:14:22,896 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:22,896 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 541a55fdcb2553a5eba9afc162ecc7fd 2023-07-12 16:14:22,897 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:22,897 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 541a55fdcb2553a5eba9afc162ecc7fd 2023-07-12 16:14:22,897 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 541a55fdcb2553a5eba9afc162ecc7fd 2023-07-12 16:14:22,899 INFO [StoreOpener-541a55fdcb2553a5eba9afc162ecc7fd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 541a55fdcb2553a5eba9afc162ecc7fd 2023-07-12 16:14:22,902 DEBUG [StoreOpener-541a55fdcb2553a5eba9afc162ecc7fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/namespace/541a55fdcb2553a5eba9afc162ecc7fd/info 2023-07-12 16:14:22,902 DEBUG [StoreOpener-541a55fdcb2553a5eba9afc162ecc7fd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/namespace/541a55fdcb2553a5eba9afc162ecc7fd/info 2023-07-12 16:14:22,902 INFO [StoreOpener-541a55fdcb2553a5eba9afc162ecc7fd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 541a55fdcb2553a5eba9afc162ecc7fd columnFamilyName info 2023-07-12 16:14:22,903 INFO [StoreOpener-541a55fdcb2553a5eba9afc162ecc7fd-1] regionserver.HStore(310): Store=541a55fdcb2553a5eba9afc162ecc7fd/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:22,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/namespace/541a55fdcb2553a5eba9afc162ecc7fd 2023-07-12 16:14:22,907 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/namespace/541a55fdcb2553a5eba9afc162ecc7fd 2023-07-12 16:14:22,912 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 541a55fdcb2553a5eba9afc162ecc7fd 2023-07-12 16:14:22,917 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/namespace/541a55fdcb2553a5eba9afc162ecc7fd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:22,918 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 541a55fdcb2553a5eba9afc162ecc7fd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59845406, jitterRate=-0.10823395848274231}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:14:22,918 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 541a55fdcb2553a5eba9afc162ecc7fd: 2023-07-12 16:14:22,923 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd., pid=6, masterSystemTime=1689178462883 2023-07-12 16:14:22,928 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd. 2023-07-12 16:14:22,929 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd. 2023-07-12 16:14:22,931 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=541a55fdcb2553a5eba9afc162ecc7fd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:22,931 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689178462930"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178462930"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178462930"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178462930"}]},"ts":"1689178462930"} 2023-07-12 16:14:22,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 16:14:22,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 541a55fdcb2553a5eba9afc162ecc7fd, server=jenkins-hbase5.apache.org,45885,1689178459339 in 210 msec 2023-07-12 16:14:22,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 16:14:22,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=541a55fdcb2553a5eba9afc162ecc7fd, ASSIGN in 388 msec 2023-07-12 16:14:22,949 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:14:22,949 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178462949"}]},"ts":"1689178462949"} 2023-07-12 16:14:22,951 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 16:14:22,954 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:14:22,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 608 msec 2023-07-12 16:14:22,961 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 16:14:22,962 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 16:14:22,962 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:22,983 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:22,985 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:47630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:22,997 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 16:14:23,015 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 16:14:23,020 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-07-12 16:14:23,032 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 16:14:23,045 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 16:14:23,051 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-12 16:14:23,064 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 16:14:23,067 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 16:14:23,068 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.515sec 2023-07-12 16:14:23,071 INFO [master/jenkins-hbase5:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 16:14:23,074 INFO [master/jenkins-hbase5:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 16:14:23,074 INFO [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 16:14:23,075 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,41835,1689178457829-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 16:14:23,076 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,41835,1689178457829-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 16:14:23,103 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 16:14:23,105 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-12 16:14:23,107 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:14:23,109 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:14:23,112 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-12 16:14:23,113 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/hbase/acl/fe7e09767cef83945a49f51c58cf2c8c 2023-07-12 16:14:23,114 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/hbase/acl/fe7e09767cef83945a49f51c58cf2c8c empty. 2023-07-12 16:14:23,117 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/hbase/acl/fe7e09767cef83945a49f51c58cf2c8c 2023-07-12 16:14:23,117 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-12 16:14:23,120 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 16:14:23,122 DEBUG [Listener at localhost/37637] zookeeper.ReadOnlyZKClient(139): Connect 0x1f336f33 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:23,136 DEBUG [Listener at localhost/37637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cbb53b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:23,159 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-12 16:14:23,161 DEBUG [hconnection-0x11229028-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:23,161 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => fe7e09767cef83945a49f51c58cf2c8c, NAME => 'hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:14:23,178 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:52258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:23,185 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase5.apache.org,41835,1689178457829 2023-07-12 16:14:23,186 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-12 16:14:23,187 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/test.cache.data in system properties and HBase conf 2023-07-12 16:14:23,187 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 16:14:23,188 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop.log.dir in system properties and HBase conf 2023-07-12 16:14:23,188 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 16:14:23,188 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 16:14:23,188 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 16:14:23,189 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 16:14:23,189 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 16:14:23,189 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 16:14:23,189 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 16:14:23,189 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 16:14:23,189 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 16:14:23,189 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 16:14:23,189 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 16:14:23,189 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 16:14:23,189 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/nfs.dump.dir in system properties and HBase conf 2023-07-12 16:14:23,190 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/java.io.tmpdir in system properties and HBase conf 2023-07-12 16:14:23,190 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 16:14:23,190 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 16:14:23,190 INFO [Listener at localhost/37637] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-12 16:14:23,190 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:23,190 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing fe7e09767cef83945a49f51c58cf2c8c, disabling compactions & flushes 2023-07-12 16:14:23,190 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c. 2023-07-12 16:14:23,190 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c. 2023-07-12 16:14:23,190 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c. after waiting 0 ms 2023-07-12 16:14:23,190 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c. 2023-07-12 16:14:23,190 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c. 2023-07-12 16:14:23,190 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for fe7e09767cef83945a49f51c58cf2c8c: 2023-07-12 16:14:23,201 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:14:23,202 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689178463202"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178463202"}]},"ts":"1689178463202"} 2023-07-12 16:14:23,206 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 16:14:23,207 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:14:23,208 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178463208"}]},"ts":"1689178463208"} 2023-07-12 16:14:23,211 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-12 16:14:23,217 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:14:23,218 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:14:23,219 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:14:23,219 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:14:23,219 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:14:23,219 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=fe7e09767cef83945a49f51c58cf2c8c, ASSIGN}] 2023-07-12 16:14:23,224 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=fe7e09767cef83945a49f51c58cf2c8c, ASSIGN 2023-07-12 16:14:23,225 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 16:14:23,226 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=fe7e09767cef83945a49f51c58cf2c8c, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,38727,1689178459459; forceNewPlan=false, retain=false 2023-07-12 16:14:23,376 INFO [jenkins-hbase5:41835] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 16:14:23,378 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=fe7e09767cef83945a49f51c58cf2c8c, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:23,378 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689178463377"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178463377"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178463377"}]},"ts":"1689178463377"} 2023-07-12 16:14:23,382 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure fe7e09767cef83945a49f51c58cf2c8c, server=jenkins-hbase5.apache.org,38727,1689178459459}] 2023-07-12 16:14:23,425 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 16:14:23,563 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c. 2023-07-12 16:14:23,563 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fe7e09767cef83945a49f51c58cf2c8c, NAME => 'hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c.', STARTKEY => '', ENDKEY => ''} 2023-07-12 16:14:23,563 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c. service=AccessControlService 2023-07-12 16:14:23,564 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:23,564 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl fe7e09767cef83945a49f51c58cf2c8c 2023-07-12 16:14:23,564 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:23,564 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for fe7e09767cef83945a49f51c58cf2c8c 2023-07-12 16:14:23,564 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for fe7e09767cef83945a49f51c58cf2c8c 2023-07-12 16:14:23,570 INFO [StoreOpener-fe7e09767cef83945a49f51c58cf2c8c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region fe7e09767cef83945a49f51c58cf2c8c 2023-07-12 16:14:23,576 DEBUG [StoreOpener-fe7e09767cef83945a49f51c58cf2c8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/acl/fe7e09767cef83945a49f51c58cf2c8c/l 2023-07-12 16:14:23,576 DEBUG [StoreOpener-fe7e09767cef83945a49f51c58cf2c8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/acl/fe7e09767cef83945a49f51c58cf2c8c/l 2023-07-12 16:14:23,577 INFO [StoreOpener-fe7e09767cef83945a49f51c58cf2c8c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe7e09767cef83945a49f51c58cf2c8c columnFamilyName l 2023-07-12 16:14:23,578 INFO [StoreOpener-fe7e09767cef83945a49f51c58cf2c8c-1] regionserver.HStore(310): Store=fe7e09767cef83945a49f51c58cf2c8c/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:23,585 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/acl/fe7e09767cef83945a49f51c58cf2c8c 2023-07-12 16:14:23,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/acl/fe7e09767cef83945a49f51c58cf2c8c 2023-07-12 16:14:23,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for fe7e09767cef83945a49f51c58cf2c8c 2023-07-12 16:14:23,619 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/acl/fe7e09767cef83945a49f51c58cf2c8c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:23,622 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened fe7e09767cef83945a49f51c58cf2c8c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69100817, jitterRate=0.02968241274356842}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:14:23,623 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for fe7e09767cef83945a49f51c58cf2c8c: 2023-07-12 16:14:23,627 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c., pid=11, masterSystemTime=1689178463539 2023-07-12 16:14:23,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c. 2023-07-12 16:14:23,631 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c. 2023-07-12 16:14:23,632 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=fe7e09767cef83945a49f51c58cf2c8c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:23,632 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689178463632"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178463632"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178463632"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178463632"}]},"ts":"1689178463632"} 2023-07-12 16:14:23,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 16:14:23,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure fe7e09767cef83945a49f51c58cf2c8c, server=jenkins-hbase5.apache.org,38727,1689178459459 in 254 msec 2023-07-12 16:14:23,650 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 16:14:23,650 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=fe7e09767cef83945a49f51c58cf2c8c, ASSIGN in 424 msec 2023-07-12 16:14:23,652 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:14:23,652 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178463652"}]},"ts":"1689178463652"} 2023-07-12 16:14:23,667 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-12 16:14:23,672 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:14:23,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 569 msec 2023-07-12 16:14:23,726 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 16:14:23,726 INFO [master/jenkins-hbase5:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-12 16:14:23,756 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 16:14:24,775 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:25,175 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:25,183 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/java.io.tmpdir/Jetty_jenkins.hbase5_apache_org_46679_jobhistory____7pip9a/webapp 2023-07-12 16:14:25,367 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-12 16:14:25,368 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-12 16:14:25,368 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 16:14:25,371 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 16:14:25,466 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:25,905 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:26,415 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-12 16:14:26,477 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:46679 2023-07-12 16:14:27,590 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:14:27,880 WARN [Listener at jenkins-hbase5.apache.org/43811] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:27,964 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 16:14:27,965 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-12 16:14:27,967 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 16:14:28,015 WARN [Listener at jenkins-hbase5.apache.org/43811] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 16:14:28,016 INFO [Listener at jenkins-hbase5.apache.org/43811] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:28,026 INFO [Listener at jenkins-hbase5.apache.org/43811] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/java.io.tmpdir/Jetty_jenkins.hbase5_apache_org_44289_cluster____.tbnrou/webapp 2023-07-12 16:14:28,027 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:14:28,028 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-12 16:14:28,028 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:14:28,028 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-12 16:14:28,028 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 16:14:28,028 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-12 16:14:28,029 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:14:28,029 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-12 16:14:28,029 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 16:14:28,029 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 16:14:28,102 INFO [Listener at jenkins-hbase5.apache.org/43811] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 16:14:28,103 INFO [Listener at jenkins-hbase5.apache.org/43811] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-12 16:14:28,103 INFO [Listener at jenkins-hbase5.apache.org/43811] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 16:14:28,103 INFO [Listener at jenkins-hbase5.apache.org/43811] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 16:14:28,114 INFO [Listener at jenkins-hbase5.apache.org/43811] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:28,365 INFO [Listener at jenkins-hbase5.apache.org/43811] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:28,507 INFO [Listener at jenkins-hbase5.apache.org/43811] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:28,515 INFO [Listener at jenkins-hbase5.apache.org/43811] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:44289 2023-07-12 16:14:29,025 WARN [Listener at jenkins-hbase5.apache.org/38913] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:29,054 WARN [Listener at jenkins-hbase5.apache.org/38913] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 16:14:29,055 INFO [Listener at jenkins-hbase5.apache.org/38913] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:29,067 INFO [Listener at jenkins-hbase5.apache.org/38913] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/java.io.tmpdir/Jetty_jenkins.hbase5_apache_org_40747_node____.rra65h/webapp 2023-07-12 16:14:29,124 INFO [Listener at jenkins-hbase5.apache.org/38913] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 16:14:29,125 INFO [Listener at jenkins-hbase5.apache.org/38913] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 16:14:29,125 INFO [Listener at jenkins-hbase5.apache.org/38913] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 16:14:29,125 INFO [Listener at jenkins-hbase5.apache.org/38913] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 16:14:29,133 INFO [Listener at jenkins-hbase5.apache.org/38913] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:29,158 INFO [Listener at jenkins-hbase5.apache.org/38913] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:29,265 INFO [Listener at jenkins-hbase5.apache.org/38913] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:29,303 INFO [Listener at jenkins-hbase5.apache.org/38913] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:40747 2023-07-12 16:14:29,627 WARN [Listener at jenkins-hbase5.apache.org/43841] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:29,636 WARN [Listener at jenkins-hbase5.apache.org/43841] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 16:14:29,636 INFO [Listener at jenkins-hbase5.apache.org/43841] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:29,652 INFO [Listener at jenkins-hbase5.apache.org/43841] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/java.io.tmpdir/Jetty_jenkins.hbase5_apache_org_46437_node____6falgz/webapp 2023-07-12 16:14:29,709 INFO [Listener at jenkins-hbase5.apache.org/43841] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 16:14:29,710 INFO [Listener at jenkins-hbase5.apache.org/43841] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 16:14:29,710 INFO [Listener at jenkins-hbase5.apache.org/43841] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 16:14:29,710 INFO [Listener at jenkins-hbase5.apache.org/43841] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 16:14:29,722 INFO [Listener at jenkins-hbase5.apache.org/43841] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:29,745 INFO [Listener at jenkins-hbase5.apache.org/43841] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:29,839 INFO [Listener at jenkins-hbase5.apache.org/43841] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:29,854 INFO [Listener at jenkins-hbase5.apache.org/43841] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:46437 2023-07-12 16:14:29,891 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-12 16:14:29,893 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:14:29,976 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=259, ProcessCount=163, AvailableMemoryMB=6207 2023-07-12 16:14:29,976 WARN [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-07-12 16:14:29,992 DEBUG [Listener at jenkins-hbase5.apache.org/43841] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 16:14:30,001 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:43850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 16:14:30,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 16:14:30,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:30,026 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:14:30,028 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:14:30,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-12 16:14:30,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 16:14:30,038 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab 2023-07-12 16:14:30,039 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b 2023-07-12 16:14:30,040 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab empty. 2023-07-12 16:14:30,040 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b empty. 2023-07-12 16:14:30,042 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab 2023-07-12 16:14:30,042 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b 2023-07-12 16:14:30,043 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 16:14:30,088 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-12 16:14:30,104 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => e6abe614e71161f0802b1039fdda90ab, NAME => 'testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:14:30,104 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5958a9ea447c54e7d103b500aee4c97b, NAME => 'testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:14:30,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 16:14:30,165 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:30,166 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:30,171 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 5958a9ea447c54e7d103b500aee4c97b, disabling compactions & flushes 2023-07-12 16:14:30,171 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing e6abe614e71161f0802b1039fdda90ab, disabling compactions & flushes 2023-07-12 16:14:30,171 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. 2023-07-12 16:14:30,171 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:30,171 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. 2023-07-12 16:14:30,171 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:30,171 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. after waiting 0 ms 2023-07-12 16:14:30,172 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. after waiting 0 ms 2023-07-12 16:14:30,172 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. 2023-07-12 16:14:30,172 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:30,172 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:30,172 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. 2023-07-12 16:14:30,172 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for e6abe614e71161f0802b1039fdda90ab: 2023-07-12 16:14:30,172 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 5958a9ea447c54e7d103b500aee4c97b: 2023-07-12 16:14:30,176 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:14:30,177 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178470177"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178470177"}]},"ts":"1689178470177"} 2023-07-12 16:14:30,178 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178470177"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178470177"}]},"ts":"1689178470177"} 2023-07-12 16:14:30,227 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 16:14:30,229 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:14:30,230 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178470229"}]},"ts":"1689178470229"} 2023-07-12 16:14:30,232 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-12 16:14:30,237 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:14:30,238 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:14:30,239 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:14:30,239 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:14:30,239 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:14:30,239 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e6abe614e71161f0802b1039fdda90ab, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5958a9ea447c54e7d103b500aee4c97b, ASSIGN}] 2023-07-12 16:14:30,241 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5958a9ea447c54e7d103b500aee4c97b, ASSIGN 2023-07-12 16:14:30,242 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e6abe614e71161f0802b1039fdda90ab, ASSIGN 2023-07-12 16:14:30,243 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5958a9ea447c54e7d103b500aee4c97b, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,36809,1689178459409; forceNewPlan=false, retain=false 2023-07-12 16:14:30,243 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e6abe614e71161f0802b1039fdda90ab, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,45885,1689178459339; forceNewPlan=false, retain=false 2023-07-12 16:14:30,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 16:14:30,393 INFO [jenkins-hbase5:41835] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 16:14:30,395 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5958a9ea447c54e7d103b500aee4c97b, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:30,395 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e6abe614e71161f0802b1039fdda90ab, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:30,396 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178470395"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178470395"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178470395"}]},"ts":"1689178470395"} 2023-07-12 16:14:30,396 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178470395"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178470395"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178470395"}]},"ts":"1689178470395"} 2023-07-12 16:14:30,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 5958a9ea447c54e7d103b500aee4c97b, server=jenkins-hbase5.apache.org,36809,1689178459409}] 2023-07-12 16:14:30,400 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure e6abe614e71161f0802b1039fdda90ab, server=jenkins-hbase5.apache.org,45885,1689178459339}] 2023-07-12 16:14:30,552 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:30,552 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 16:14:30,556 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:55404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 16:14:30,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:30,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e6abe614e71161f0802b1039fdda90ab, NAME => 'testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 16:14:30,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. service=AccessControlService 2023-07-12 16:14:30,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:30,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e6abe614e71161f0802b1039fdda90ab 2023-07-12 16:14:30,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:30,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for e6abe614e71161f0802b1039fdda90ab 2023-07-12 16:14:30,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for e6abe614e71161f0802b1039fdda90ab 2023-07-12 16:14:30,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. 2023-07-12 16:14:30,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5958a9ea447c54e7d103b500aee4c97b, NAME => 'testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 16:14:30,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. service=AccessControlService 2023-07-12 16:14:30,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:30,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5958a9ea447c54e7d103b500aee4c97b 2023-07-12 16:14:30,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:30,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 5958a9ea447c54e7d103b500aee4c97b 2023-07-12 16:14:30,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 5958a9ea447c54e7d103b500aee4c97b 2023-07-12 16:14:30,564 INFO [StoreOpener-e6abe614e71161f0802b1039fdda90ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e6abe614e71161f0802b1039fdda90ab 2023-07-12 16:14:30,565 INFO [StoreOpener-5958a9ea447c54e7d103b500aee4c97b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5958a9ea447c54e7d103b500aee4c97b 2023-07-12 16:14:30,566 DEBUG [StoreOpener-e6abe614e71161f0802b1039fdda90ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/cf 2023-07-12 16:14:30,566 DEBUG [StoreOpener-e6abe614e71161f0802b1039fdda90ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/cf 2023-07-12 16:14:30,567 INFO [StoreOpener-e6abe614e71161f0802b1039fdda90ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6abe614e71161f0802b1039fdda90ab columnFamilyName cf 2023-07-12 16:14:30,567 DEBUG [StoreOpener-5958a9ea447c54e7d103b500aee4c97b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/cf 2023-07-12 16:14:30,567 DEBUG [StoreOpener-5958a9ea447c54e7d103b500aee4c97b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/cf 2023-07-12 16:14:30,568 INFO [StoreOpener-e6abe614e71161f0802b1039fdda90ab-1] regionserver.HStore(310): Store=e6abe614e71161f0802b1039fdda90ab/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:30,569 INFO [StoreOpener-5958a9ea447c54e7d103b500aee4c97b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5958a9ea447c54e7d103b500aee4c97b columnFamilyName cf 2023-07-12 16:14:30,570 INFO [StoreOpener-5958a9ea447c54e7d103b500aee4c97b-1] regionserver.HStore(310): Store=5958a9ea447c54e7d103b500aee4c97b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:30,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab 2023-07-12 16:14:30,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab 2023-07-12 16:14:30,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b 2023-07-12 16:14:30,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b 2023-07-12 16:14:30,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for e6abe614e71161f0802b1039fdda90ab 2023-07-12 16:14:30,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 5958a9ea447c54e7d103b500aee4c97b 2023-07-12 16:14:30,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:30,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:30,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened e6abe614e71161f0802b1039fdda90ab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67218366, jitterRate=0.001631706953048706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:14:30,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for e6abe614e71161f0802b1039fdda90ab: 2023-07-12 16:14:30,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 5958a9ea447c54e7d103b500aee4c97b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64436750, jitterRate=-0.039817601442337036}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:14:30,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 5958a9ea447c54e7d103b500aee4c97b: 2023-07-12 16:14:30,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab., pid=16, masterSystemTime=1689178470552 2023-07-12 16:14:30,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b., pid=15, masterSystemTime=1689178470552 2023-07-12 16:14:30,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:30,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:30,600 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e6abe614e71161f0802b1039fdda90ab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:30,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. 2023-07-12 16:14:30,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. 2023-07-12 16:14:30,602 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178470600"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178470600"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178470600"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178470600"}]},"ts":"1689178470600"} 2023-07-12 16:14:30,603 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5958a9ea447c54e7d103b500aee4c97b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:30,603 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178470603"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178470603"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178470603"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178470603"}]},"ts":"1689178470603"} 2023-07-12 16:14:30,612 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-12 16:14:30,614 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure e6abe614e71161f0802b1039fdda90ab, server=jenkins-hbase5.apache.org,45885,1689178459339 in 206 msec 2023-07-12 16:14:30,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-12 16:14:30,617 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 5958a9ea447c54e7d103b500aee4c97b, server=jenkins-hbase5.apache.org,36809,1689178459409 in 209 msec 2023-07-12 16:14:30,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e6abe614e71161f0802b1039fdda90ab, ASSIGN in 373 msec 2023-07-12 16:14:30,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-12 16:14:30,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5958a9ea447c54e7d103b500aee4c97b, ASSIGN in 378 msec 2023-07-12 16:14:30,621 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:14:30,621 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178470621"}]},"ts":"1689178470621"} 2023-07-12 16:14:30,623 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-12 16:14:30,627 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:14:30,634 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-12 16:14:30,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 16:14:30,654 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38727] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 16:14:30,687 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:30,687 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:30,687 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:30,687 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:30,687 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:30,694 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 16:14:30,694 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:30,694 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:30,694 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:30,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 677 msec 2023-07-12 16:14:30,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:31,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 16:14:31,154 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-12 16:14:31,154 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-12 16:14:31,156 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:14:31,161 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-12 16:14:31,162 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:14:31,162 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-12 16:14:31,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 16:14:31,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178471178 (current time:1689178471178). 2023-07-12 16:14:31,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:14:31,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x5381ac43 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:31,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63216c6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:31,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:31,193 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:37780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:31,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5381ac43 to 127.0.0.1:62419 2023-07-12 16:14:31,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:31,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x048195a1 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:31,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30f7e9b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:31,211 DEBUG [hconnection-0x36d8d9d4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:31,213 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:37782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:31,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x048195a1 to 127.0.0.1:62419 2023-07-12 16:14:31,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:31,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 16:14:31,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:14:31,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 16:14:31,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 16:14:31,270 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 16:14:31,273 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689179071273 2023-07-12 16:14:31,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 16:14:31,273 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 16:14:31,276 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 16:14:31,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 16:14:31,280 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:14:31,280 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:14:31,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-12 16:14:31,282 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 16:14:31,283 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689179071283 2023-07-12 16:14:31,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,338 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-12 16:14:31,339 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:31,339 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 16:14:31,339 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 16:14:31,340 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,340 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,345 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:31,345 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:31,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:31,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:31,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:31,345 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:31,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:31,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:31,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:31,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,347 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,347 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,347 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,347 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,348 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 16:14:31,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 16:14:31,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,349 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 16:14:31,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 16:14:31,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,349 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 16:14:31,348 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,349 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 16:14:31,351 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,351 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:14:31,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,352 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 16:14:31,352 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 16:14:31,353 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 16:14:31,353 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:31,353 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:31,353 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:31,354 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 16:14:31,355 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 16:14:31,355 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 16:14:31,355 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 16:14:31,355 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 16:14:31,354 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 16:14:31,355 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 16:14:31,355 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 16:14:31,355 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 16:14:31,358 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,360 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,360 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,360 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,360 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:31,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:31,361 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,361 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:31,361 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,361 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:31,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:31,362 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,362 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:31,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:31,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:31,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:31,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 16:14:31,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d465784[Count = 1] remaining members to acquire global barrier 2023-07-12 16:14:31,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:31,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:31,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:31,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:31,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:31,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 16:14:31,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d465784[Count = 0] remaining members to acquire global barrier 2023-07-12 16:14:31,378 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 16:14:31,378 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,385 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:31,386 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,386 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 16:14:31,387 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,387 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,387 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,388 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,389 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:14:31,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 16:14:31,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:14:31,391 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:14:31,393 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 16:14:31,393 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:31,393 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 16:14:31,393 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 16:14:31,393 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:31,393 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:31,393 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,38727,1689178459459' in zk 2023-07-12 16:14:31,394 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. started... 2023-07-12 16:14:31,398 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. 2023-07-12 16:14:31,398 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:31,400 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 16:14:31,400 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. started... 2023-07-12 16:14:31,400 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:31,400 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:31,400 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 16:14:31,403 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5958a9ea447c54e7d103b500aee4c97b: 2023-07-12 16:14:31,403 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e6abe614e71161f0802b1039fdda90ab: 2023-07-12 16:14:31,405 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,405 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,411 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:31,411 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:31,415 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:14:31,415 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:14:31,478 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. completed. 2023-07-12 16:14:31,478 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:31,479 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:31,479 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:31,479 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,479 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 16:14:31,479 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,45885,1689178459339' in zk 2023-07-12 16:14:31,482 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 16:14:31,482 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,482 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:31,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,482 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 16:14:31,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:31,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:31,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:31,485 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. completed. 2023-07-12 16:14:31,485 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. 2023-07-12 16:14:31,485 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:31,485 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:31,485 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,485 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 16:14:31,485 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,36809,1689178459409' in zk 2023-07-12 16:14:31,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:31,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,487 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 16:14:31,487 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:31,487 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 16:14:31,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:31,487 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:31,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:31,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase5.apache.org,45885,1689178459339': 2023-07-12 16:14:31,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 16:14:31,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:31,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:31,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:31,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:31,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:31,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:31,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:31,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase5.apache.org,36809,1689178459409': 2023-07-12 16:14:31,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 16:14:31,501 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-12 16:14:31,501 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:14:31,501 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:14:31,501 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,501 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:14:31,504 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,504 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,504 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:31,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,504 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,504 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:31,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:31,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:31,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,504 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,504 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:31,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:31,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:31,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:31,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:31,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:31,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:31,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:31,505 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:31,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,506 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:31,507 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:31,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:31,510 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:31,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,510 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:31,511 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,527 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,527 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,527 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:31,527 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:31,527 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:31,527 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:31,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:31,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:31,527 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,527 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:31,527 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:31,527 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,527 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:31,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:31,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:31,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:31,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:31,528 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:31,527 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:31,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:31,529 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:31,529 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,530 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:31,530 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:31,530 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,530 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:31,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:31,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:31,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:31,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,592 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:31,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 16:14:31,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:14:31,597 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 16:14:31,647 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 16:14:31,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,648 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689178471273Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689178471528 (+255 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689178471529 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689178471547 (+18 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689178471571 (+24 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689178471647 (+76 ms) 2023-07-12 16:14:31,651 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 16:14:31,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 376 msec 2023-07-12 16:14:31,897 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:31,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 16:14:31,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:14:31,922 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:31,922 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:31,928 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:54878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:31,928 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:55410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:31,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:14:31,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36809] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:14:31,936 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 16:14:31,936 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:31,939 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:14:31,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 16:14:31,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178471976 (current time:1689178471976). 2023-07-12 16:14:31,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:14:31,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x1cd50d2b to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:31,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@448f2057, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:31,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:31,988 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:37784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:31,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1cd50d2b to 127.0.0.1:62419 2023-07-12 16:14:31,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:31,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x02fdda1f to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:31,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36f5233e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:32,001 DEBUG [hconnection-0xb45302f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:32,004 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:37796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:32,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02fdda1f to 127.0.0.1:62419 2023-07-12 16:14:32,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:32,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 16:14:32,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:14:32,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 16:14:32,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 16:14:32,017 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 16:14:32,018 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689179072018 2023-07-12 16:14:32,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 16:14:32,019 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 16:14:32,027 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:14:32,027 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:14:32,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 16:14:32,037 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 16:14:32,046 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 25 msec 2023-07-12 16:14:32,047 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 16:14:32,048 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689179072048 2023-07-12 16:14:32,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-12 16:14:32,098 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-12 16:14:32,098 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:32,099 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 16:14:32,100 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 16:14:32,100 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,100 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,102 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:32,102 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:32,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:32,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:32,102 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,102 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:32,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:32,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:32,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:32,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:32,103 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,103 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,104 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,104 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:14:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 16:14:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 16:14:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 16:14:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,104 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 16:14:32,104 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 16:14:32,104 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 16:14:32,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 16:14:32,105 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 16:14:32,105 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:32,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 16:14:32,106 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 16:14:32,106 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 16:14:32,106 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 16:14:32,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 16:14:32,106 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 16:14:32,106 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 16:14:32,106 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:32,107 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:32,107 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 16:14:32,109 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 16:14:32,109 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 16:14:32,109 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 16:14:32,109 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 16:14:32,109 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 16:14:32,111 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,111 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:32,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:32,113 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,113 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,113 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:32,115 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:32,115 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,115 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,115 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:32,115 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,116 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:32,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:32,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:32,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:32,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 16:14:32,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bfcc834[Count = 1] remaining members to acquire global barrier 2023-07-12 16:14:32,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:32,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:32,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:32,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:32,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:32,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:32,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 16:14:32,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bfcc834[Count = 0] remaining members to acquire global barrier 2023-07-12 16:14:32,123 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 16:14:32,123 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,127 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,127 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,127 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,127 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 16:14:32,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,128 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:32,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,128 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 16:14:32,128 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,128 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,38727,1689178459459' in zk 2023-07-12 16:14:32,128 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 16:14:32,128 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 16:14:32,128 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,129 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:14:32,129 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:32,129 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:32,129 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. 2023-07-12 16:14:32,129 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:32,129 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:32,129 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:32,129 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. started... 2023-07-12 16:14:32,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 16:14:32,129 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. started... 2023-07-12 16:14:32,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:14:32,130 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5958a9ea447c54e7d103b500aee4c97b 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-12 16:14:32,130 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e6abe614e71161f0802b1039fdda90ab 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-12 16:14:32,131 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:14:32,132 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 16:14:32,132 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:32,132 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 16:14:32,262 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/.tmp/cf/60cc30040dc74ce8a0586942044bab6d 2023-07-12 16:14:32,267 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/.tmp/cf/b0f1da8bd8004aad9a9ce081130b4085 2023-07-12 16:14:32,319 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/.tmp/cf/60cc30040dc74ce8a0586942044bab6d as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/cf/60cc30040dc74ce8a0586942044bab6d 2023-07-12 16:14:32,319 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/.tmp/cf/b0f1da8bd8004aad9a9ce081130b4085 as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/cf/b0f1da8bd8004aad9a9ce081130b4085 2023-07-12 16:14:32,332 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:32,335 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/cf/60cc30040dc74ce8a0586942044bab6d, entries=2, sequenceid=6, filesize=5.0 K 2023-07-12 16:14:32,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 16:14:32,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:14:32,337 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 16:14:32,339 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for e6abe614e71161f0802b1039fdda90ab in 209ms, sequenceid=6, compaction requested=false 2023-07-12 16:14:32,339 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 16:14:32,340 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e6abe614e71161f0802b1039fdda90ab: 2023-07-12 16:14:32,340 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 16:14:32,340 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:32,341 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/cf/60cc30040dc74ce8a0586942044bab6d] hfiles 2023-07-12 16:14:32,341 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/cf/b0f1da8bd8004aad9a9ce081130b4085, entries=48, sequenceid=6, filesize=8.1 K 2023-07-12 16:14:32,341 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/cf/60cc30040dc74ce8a0586942044bab6d for snapshot=snaptb0-testExportWithTargetName 2023-07-12 16:14:32,344 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 5958a9ea447c54e7d103b500aee4c97b in 213ms, sequenceid=6, compaction requested=false 2023-07-12 16:14:32,345 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5958a9ea447c54e7d103b500aee4c97b: 2023-07-12 16:14:32,346 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 16:14:32,346 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:32,346 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/cf/b0f1da8bd8004aad9a9ce081130b4085] hfiles 2023-07-12 16:14:32,346 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/cf/b0f1da8bd8004aad9a9ce081130b4085 for snapshot=snaptb0-testExportWithTargetName 2023-07-12 16:14:32,383 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. completed. 2023-07-12 16:14:32,383 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. 2023-07-12 16:14:32,383 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:32,383 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:32,383 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,384 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 16:14:32,384 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,36809,1689178459409' in zk 2023-07-12 16:14:32,387 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 16:14:32,387 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:32,388 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:32,388 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 16:14:32,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:32,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:32,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,391 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. completed. 2023-07-12 16:14:32,391 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:32,391 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:32,391 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:32,391 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,391 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 16:14:32,391 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,45885,1689178459339' in zk 2023-07-12 16:14:32,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:32,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,393 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,393 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 16:14:32,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,393 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:32,393 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 16:14:32,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:32,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:32,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase5.apache.org,36809,1689178459409': 2023-07-12 16:14:32,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 16:14:32,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:32,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:32,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:32,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:32,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:32,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:32,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase5.apache.org,45885,1689178459339': 2023-07-12 16:14:32,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 16:14:32,401 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-12 16:14:32,401 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:14:32,401 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:14:32,401 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-12 16:14:32,401 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:14:32,403 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,403 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:32,403 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,403 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,403 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:32,403 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,403 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:32,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:32,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:32,405 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:32,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,406 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:32,407 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,410 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:32,410 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:32,411 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,428 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,428 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,428 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:32,428 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,428 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:32,428 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:32,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:32,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:32,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:32,429 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:32,429 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-12 16:14:32,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-12 16:14:32,428 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:32,428 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:32,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:32,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:32,428 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:32,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:32,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:32,431 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,431 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:32,431 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,431 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:32,431 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:32,431 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,431 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,430 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:32,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:32,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:32,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:32,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,558 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 16:14:32,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,559 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689178472019Consolidate snapshot: snaptb0-testExportWithTargetName at 1689178472429 (+410 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689178472429Writing data manifest for snaptb0-testExportWithTargetName at 1689178472443 (+14 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689178472484 (+41 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689178472558 (+74 ms) 2023-07-12 16:14:32,560 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 16:14:32,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 540 msec 2023-07-12 16:14:32,637 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:32,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 16:14:32,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:14:32,641 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178472641 2023-07-12 16:14:32,641 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39241, tgtDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178472641, rawTgtDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178472641, srcFsUri=hdfs://localhost:39241, srcDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:14:32,686 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39241, inputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:14:32,687 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1536767178_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178472641, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178472641/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 16:14:32,687 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39241, inputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca, snapshotDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-12 16:14:32,706 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178472641/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 16:14:32,804 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:32,805 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:32,806 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:32,806 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,872 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop-4556639714620620925.jar 2023-07-12 16:14:33,873 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,873 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,947 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop-1154444175167070913.jar 2023-07-12 16:14:33,948 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,949 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,949 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,950 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,950 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,951 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,951 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 16:14:33,952 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 16:14:33,952 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 16:14:33,953 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 16:14:33,954 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 16:14:33,955 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 16:14:33,955 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 16:14:33,956 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 16:14:33,956 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 16:14:33,957 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 16:14:33,962 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:33,963 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:33,964 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:14:33,964 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:33,965 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:33,966 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:14:33,966 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:14:35,099 WARN [Listener at jenkins-hbase5.apache.org/43841] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 16:14:35,106 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-12 16:14:35,115 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 16:14:35,622 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:14:35,623 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:14:36,071 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0001_000001 (auth:SIMPLE) 2023-07-12 16:14:36,086 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:14:41,550 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0001_000001 (auth:SIMPLE) 2023-07-12 16:14:43,802 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0001_000001 (auth:SIMPLE) 2023-07-12 16:14:46,757 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0001_000001 (auth:SIMPLE) 2023-07-12 16:14:48,101 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 16:14:48,105 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 16:14:48,119 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-12 16:14:48,119 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 16:14:48,120 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 16:14:48,120 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1856420832_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 16:14:48,121 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-12 16:14:48,121 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-12 16:14:48,122 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1856420832_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178472641/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178472641/.hbase-snapshot/testExportWithTargetName 2023-07-12 16:14:48,122 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178472641/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-12 16:14:48,122 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178472641/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-12 16:14:48,144 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-12 16:14:48,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testExportWithTargetName 2023-07-12 16:14:48,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:48,167 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178488167"}]},"ts":"1689178488167"} 2023-07-12 16:14:48,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 16:14:48,169 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-12 16:14:48,171 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-12 16:14:48,172 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e6abe614e71161f0802b1039fdda90ab, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5958a9ea447c54e7d103b500aee4c97b, UNASSIGN}] 2023-07-12 16:14:48,175 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e6abe614e71161f0802b1039fdda90ab, UNASSIGN 2023-07-12 16:14:48,175 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5958a9ea447c54e7d103b500aee4c97b, UNASSIGN 2023-07-12 16:14:48,176 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e6abe614e71161f0802b1039fdda90ab, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:48,176 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=5958a9ea447c54e7d103b500aee4c97b, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:48,176 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178488176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178488176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178488176"}]},"ts":"1689178488176"} 2023-07-12 16:14:48,176 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178488176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178488176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178488176"}]},"ts":"1689178488176"} 2023-07-12 16:14:48,179 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 5958a9ea447c54e7d103b500aee4c97b, server=jenkins-hbase5.apache.org,36809,1689178459409}] 2023-07-12 16:14:48,179 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure e6abe614e71161f0802b1039fdda90ab, server=jenkins-hbase5.apache.org,45885,1689178459339}] 2023-07-12 16:14:48,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 16:14:48,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close e6abe614e71161f0802b1039fdda90ab 2023-07-12 16:14:48,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 5958a9ea447c54e7d103b500aee4c97b 2023-07-12 16:14:48,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing e6abe614e71161f0802b1039fdda90ab, disabling compactions & flushes 2023-07-12 16:14:48,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 5958a9ea447c54e7d103b500aee4c97b, disabling compactions & flushes 2023-07-12 16:14:48,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:48,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. 2023-07-12 16:14:48,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:48,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. 2023-07-12 16:14:48,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. after waiting 0 ms 2023-07-12 16:14:48,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:48,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. after waiting 0 ms 2023-07-12 16:14:48,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. 2023-07-12 16:14:48,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:14:48,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:14:48,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:14:48,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:14:48,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b. 2023-07-12 16:14:48,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab. 2023-07-12 16:14:48,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 5958a9ea447c54e7d103b500aee4c97b: 2023-07-12 16:14:48,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for e6abe614e71161f0802b1039fdda90ab: 2023-07-12 16:14:48,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 5958a9ea447c54e7d103b500aee4c97b 2023-07-12 16:14:48,360 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=5958a9ea447c54e7d103b500aee4c97b, regionState=CLOSED 2023-07-12 16:14:48,360 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178488360"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178488360"}]},"ts":"1689178488360"} 2023-07-12 16:14:48,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed e6abe614e71161f0802b1039fdda90ab 2023-07-12 16:14:48,361 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e6abe614e71161f0802b1039fdda90ab, regionState=CLOSED 2023-07-12 16:14:48,361 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178488361"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178488361"}]},"ts":"1689178488361"} 2023-07-12 16:14:48,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-12 16:14:48,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 5958a9ea447c54e7d103b500aee4c97b, server=jenkins-hbase5.apache.org,36809,1689178459409 in 184 msec 2023-07-12 16:14:48,365 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-12 16:14:48,365 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure e6abe614e71161f0802b1039fdda90ab, server=jenkins-hbase5.apache.org,45885,1689178459339 in 184 msec 2023-07-12 16:14:48,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5958a9ea447c54e7d103b500aee4c97b, UNASSIGN in 192 msec 2023-07-12 16:14:48,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-12 16:14:48,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e6abe614e71161f0802b1039fdda90ab, UNASSIGN in 193 msec 2023-07-12 16:14:48,369 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178488368"}]},"ts":"1689178488368"} 2023-07-12 16:14:48,370 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-12 16:14:48,372 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-12 16:14:48,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 218 msec 2023-07-12 16:14:48,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 16:14:48,471 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-12 16:14:48,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testExportWithTargetName 2023-07-12 16:14:48,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:48,485 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:48,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-12 16:14:48,487 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:48,491 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38727] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-12 16:14:48,493 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab 2023-07-12 16:14:48,493 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b 2023-07-12 16:14:48,494 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 16:14:48,494 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 16:14:48,494 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 16:14:48,494 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 16:14:48,495 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 16:14:48,495 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 16:14:48,495 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 16:14:48,495 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 16:14:48,497 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 16:14:48,497 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 16:14:48,497 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:48,497 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:48,497 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 16:14:48,497 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 16:14:48,497 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:48,497 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:48,497 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/cf, FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/recovered.edits] 2023-07-12 16:14:48,497 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/cf, FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/recovered.edits] 2023-07-12 16:14:48,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 16:14:48,507 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/cf/b0f1da8bd8004aad9a9ce081130b4085 to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/cf/b0f1da8bd8004aad9a9ce081130b4085 2023-07-12 16:14:48,507 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/cf/60cc30040dc74ce8a0586942044bab6d to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/cf/60cc30040dc74ce8a0586942044bab6d 2023-07-12 16:14:48,511 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/recovered.edits/9.seqid to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b/recovered.edits/9.seqid 2023-07-12 16:14:48,511 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/recovered.edits/9.seqid to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab/recovered.edits/9.seqid 2023-07-12 16:14:48,512 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/5958a9ea447c54e7d103b500aee4c97b 2023-07-12 16:14:48,512 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportWithTargetName/e6abe614e71161f0802b1039fdda90ab 2023-07-12 16:14:48,512 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 16:14:48,515 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:48,536 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-12 16:14:48,539 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-12 16:14:48,540 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:48,540 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-12 16:14:48,540 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178488540"}]},"ts":"9223372036854775807"} 2023-07-12 16:14:48,541 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178488540"}]},"ts":"9223372036854775807"} 2023-07-12 16:14:48,543 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 16:14:48,543 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e6abe614e71161f0802b1039fdda90ab, NAME => 'testtb-testExportWithTargetName,,1689178470017.e6abe614e71161f0802b1039fdda90ab.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5958a9ea447c54e7d103b500aee4c97b, NAME => 'testtb-testExportWithTargetName,1,1689178470017.5958a9ea447c54e7d103b500aee4c97b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 16:14:48,543 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-12 16:14:48,543 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689178488543"}]},"ts":"9223372036854775807"} 2023-07-12 16:14:48,545 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-12 16:14:48,547 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:48,549 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 70 msec 2023-07-12 16:14:48,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 16:14:48,602 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-12 16:14:48,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-12 16:14:48,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:48,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-12 16:14:48,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-12 16:14:48,657 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=757 (was 709) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase5.apache.org/172.31.10.131:44819 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase5.apache.org/172.31.10.131:37717 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1856420832_17 at /127.0.0.1:33928 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_4729014_1 at /127.0.0.1:33898 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1856420832_17 at /127.0.0.1:48346 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-251060360_17 at /127.0.0.1:39150 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_4729014_1 at /127.0.0.1:48330 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=288 (was 259) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 163) - ProcessCount LEAK? -, AvailableMemoryMB=4405 (was 6207) 2023-07-12 16:14:48,658 WARN [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-12 16:14:48,677 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=757, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=288, ProcessCount=169, AvailableMemoryMB=4404 2023-07-12 16:14:48,677 WARN [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-12 16:14:48,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 16:14:48,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:14:48,684 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:14:48,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-12 16:14:48,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 16:14:48,685 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:14:48,688 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9 2023-07-12 16:14:48,688 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45 2023-07-12 16:14:48,689 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9 empty. 2023-07-12 16:14:48,689 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45 empty. 2023-07-12 16:14:48,689 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9 2023-07-12 16:14:48,689 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45 2023-07-12 16:14:48,689 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 16:14:48,706 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 16:14:48,707 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 634adfda451d238a3bdee5be9f0a90c9, NAME => 'testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:14:48,708 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1746e922c35deaba21101a66979edb45, NAME => 'testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:14:48,735 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:48,736 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 634adfda451d238a3bdee5be9f0a90c9, disabling compactions & flushes 2023-07-12 16:14:48,736 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:14:48,736 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:14:48,736 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. after waiting 0 ms 2023-07-12 16:14:48,736 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:14:48,736 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:48,736 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:14:48,737 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 1746e922c35deaba21101a66979edb45, disabling compactions & flushes 2023-07-12 16:14:48,737 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 634adfda451d238a3bdee5be9f0a90c9: 2023-07-12 16:14:48,737 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. 2023-07-12 16:14:48,737 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. 2023-07-12 16:14:48,737 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. after waiting 0 ms 2023-07-12 16:14:48,737 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. 2023-07-12 16:14:48,737 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. 2023-07-12 16:14:48,737 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 1746e922c35deaba21101a66979edb45: 2023-07-12 16:14:48,740 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:14:48,741 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178488741"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178488741"}]},"ts":"1689178488741"} 2023-07-12 16:14:48,741 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178488741"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178488741"}]},"ts":"1689178488741"} 2023-07-12 16:14:48,744 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 16:14:48,745 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:14:48,745 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178488745"}]},"ts":"1689178488745"} 2023-07-12 16:14:48,746 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 16:14:48,750 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:14:48,751 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:14:48,752 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:14:48,752 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:14:48,752 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:14:48,752 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=634adfda451d238a3bdee5be9f0a90c9, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1746e922c35deaba21101a66979edb45, ASSIGN}] 2023-07-12 16:14:48,754 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1746e922c35deaba21101a66979edb45, ASSIGN 2023-07-12 16:14:48,755 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=634adfda451d238a3bdee5be9f0a90c9, ASSIGN 2023-07-12 16:14:48,756 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1746e922c35deaba21101a66979edb45, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,36809,1689178459409; forceNewPlan=false, retain=false 2023-07-12 16:14:48,756 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=634adfda451d238a3bdee5be9f0a90c9, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,45885,1689178459339; forceNewPlan=false, retain=false 2023-07-12 16:14:48,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 16:14:48,906 INFO [jenkins-hbase5:41835] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 16:14:48,908 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=634adfda451d238a3bdee5be9f0a90c9, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:48,908 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=1746e922c35deaba21101a66979edb45, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:48,909 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178488908"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178488908"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178488908"}]},"ts":"1689178488908"} 2023-07-12 16:14:48,909 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178488908"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178488908"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178488908"}]},"ts":"1689178488908"} 2023-07-12 16:14:48,911 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 634adfda451d238a3bdee5be9f0a90c9, server=jenkins-hbase5.apache.org,45885,1689178459339}] 2023-07-12 16:14:48,912 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 1746e922c35deaba21101a66979edb45, server=jenkins-hbase5.apache.org,36809,1689178459409}] 2023-07-12 16:14:48,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 16:14:49,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:14:49,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 634adfda451d238a3bdee5be9f0a90c9, NAME => 'testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 16:14:49,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. 2023-07-12 16:14:49,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1746e922c35deaba21101a66979edb45, NAME => 'testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 16:14:49,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. service=AccessControlService 2023-07-12 16:14:49,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:49,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 634adfda451d238a3bdee5be9f0a90c9 2023-07-12 16:14:49,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:49,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 634adfda451d238a3bdee5be9f0a90c9 2023-07-12 16:14:49,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 634adfda451d238a3bdee5be9f0a90c9 2023-07-12 16:14:49,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. service=AccessControlService 2023-07-12 16:14:49,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:49,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 1746e922c35deaba21101a66979edb45 2023-07-12 16:14:49,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:49,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1746e922c35deaba21101a66979edb45 2023-07-12 16:14:49,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1746e922c35deaba21101a66979edb45 2023-07-12 16:14:49,070 INFO [StoreOpener-634adfda451d238a3bdee5be9f0a90c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 634adfda451d238a3bdee5be9f0a90c9 2023-07-12 16:14:49,070 INFO [StoreOpener-1746e922c35deaba21101a66979edb45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1746e922c35deaba21101a66979edb45 2023-07-12 16:14:49,071 DEBUG [StoreOpener-634adfda451d238a3bdee5be9f0a90c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/cf 2023-07-12 16:14:49,071 DEBUG [StoreOpener-634adfda451d238a3bdee5be9f0a90c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/cf 2023-07-12 16:14:49,072 DEBUG [StoreOpener-1746e922c35deaba21101a66979edb45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/cf 2023-07-12 16:14:49,072 DEBUG [StoreOpener-1746e922c35deaba21101a66979edb45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/cf 2023-07-12 16:14:49,072 INFO [StoreOpener-634adfda451d238a3bdee5be9f0a90c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 634adfda451d238a3bdee5be9f0a90c9 columnFamilyName cf 2023-07-12 16:14:49,072 INFO [StoreOpener-1746e922c35deaba21101a66979edb45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1746e922c35deaba21101a66979edb45 columnFamilyName cf 2023-07-12 16:14:49,073 INFO [StoreOpener-634adfda451d238a3bdee5be9f0a90c9-1] regionserver.HStore(310): Store=634adfda451d238a3bdee5be9f0a90c9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:49,075 INFO [StoreOpener-1746e922c35deaba21101a66979edb45-1] regionserver.HStore(310): Store=1746e922c35deaba21101a66979edb45/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:49,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9 2023-07-12 16:14:49,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45 2023-07-12 16:14:49,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9 2023-07-12 16:14:49,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45 2023-07-12 16:14:49,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1746e922c35deaba21101a66979edb45 2023-07-12 16:14:49,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 634adfda451d238a3bdee5be9f0a90c9 2023-07-12 16:14:49,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:49,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:49,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 634adfda451d238a3bdee5be9f0a90c9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65461483, jitterRate=-0.024547889828681946}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:14:49,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1746e922c35deaba21101a66979edb45; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59981241, jitterRate=-0.10620985925197601}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:14:49,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 634adfda451d238a3bdee5be9f0a90c9: 2023-07-12 16:14:49,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1746e922c35deaba21101a66979edb45: 2023-07-12 16:14:49,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45., pid=31, masterSystemTime=1689178489064 2023-07-12 16:14:49,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9., pid=30, masterSystemTime=1689178489063 2023-07-12 16:14:49,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:14:49,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:14:49,086 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=634adfda451d238a3bdee5be9f0a90c9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. 2023-07-12 16:14:49,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. 2023-07-12 16:14:49,087 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178489086"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178489086"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178489086"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178489086"}]},"ts":"1689178489086"} 2023-07-12 16:14:49,087 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=1746e922c35deaba21101a66979edb45, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,087 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178489087"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178489087"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178489087"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178489087"}]},"ts":"1689178489087"} 2023-07-12 16:14:49,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-12 16:14:49,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 634adfda451d238a3bdee5be9f0a90c9, server=jenkins-hbase5.apache.org,45885,1689178459339 in 178 msec 2023-07-12 16:14:49,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-12 16:14:49,095 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 1746e922c35deaba21101a66979edb45, server=jenkins-hbase5.apache.org,36809,1689178459409 in 178 msec 2023-07-12 16:14:49,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=634adfda451d238a3bdee5be9f0a90c9, ASSIGN in 341 msec 2023-07-12 16:14:49,098 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-12 16:14:49,098 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1746e922c35deaba21101a66979edb45, ASSIGN in 343 msec 2023-07-12 16:14:49,099 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:14:49,099 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178489099"}]},"ts":"1689178489099"} 2023-07-12 16:14:49,101 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 16:14:49,104 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:14:49,104 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-12 16:14:49,107 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38727] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 16:14:49,108 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:49,108 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:49,108 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:49,108 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:49,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:49,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:49,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:49,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:49,112 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 430 msec 2023-07-12 16:14:49,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 16:14:49,289 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-12 16:14:49,290 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-12 16:14:49,290 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:14:49,294 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-12 16:14:49,294 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:14:49,294 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-12 16:14:49,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:14:49,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178489298 (current time:1689178489298). 2023-07-12 16:14:49,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:14:49,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x58d39676 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:49,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ca355a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:49,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:49,353 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:45840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:49,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58d39676 to 127.0.0.1:62419 2023-07-12 16:14:49,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:49,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x07d30011 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:49,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@437746bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:49,430 DEBUG [hconnection-0x12c6db6a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:49,433 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:45844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:49,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07d30011 to 127.0.0.1:62419 2023-07-12 16:14:49,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:49,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 16:14:49,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:14:49,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:14:49,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:14:49,443 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:14:49,444 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689179089444 2023-07-12 16:14:49,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:14:49,444 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 16:14:49,445 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:14:49,446 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:14:49,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 16:14:49,447 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:14:49,449 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-12 16:14:49,449 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 16:14:49,450 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689179089450 2023-07-12 16:14:49,546 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:49,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:14:49,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:14:49,547 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:14:49,747 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:49,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:14:49,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:14:49,749 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 16:14:49,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,874 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-12 16:14:49,874 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:49,874 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 16:14:49,874 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 16:14:49,874 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,875 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,876 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:49,876 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:49,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:49,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:49,877 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,877 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:49,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,877 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,878 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,878 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,878 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:14:49,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 16:14:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 16:14:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 16:14:49,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,879 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 16:14:49,879 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 16:14:49,879 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 16:14:49,879 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,879 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 16:14:49,879 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:49,879 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,879 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,881 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 16:14:49,881 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 16:14:49,881 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 16:14:49,881 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:49,881 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:49,882 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 16:14:49,884 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 16:14:49,884 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 16:14:49,881 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 16:14:49,884 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 16:14:49,884 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 16:14:49,884 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 16:14:49,884 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 16:14:49,894 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,894 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,894 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:49,895 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,895 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,895 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:49,895 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,896 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:49,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:49,896 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,896 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:49,896 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:49,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:49,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:49,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 16:14:49,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@793b24e4[Count = 1] remaining members to acquire global barrier 2023-07-12 16:14:49,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:49,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:49,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:49,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:49,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:49,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:49,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 16:14:49,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@793b24e4[Count = 0] remaining members to acquire global barrier 2023-07-12 16:14:49,904 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 16:14:49,904 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,906 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,906 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,906 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,906 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:14:49,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,906 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:14:49,906 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:14:49,906 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,906 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 16:14:49,906 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,38727,1689178459459' in zk 2023-07-12 16:14:49,907 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:49,907 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:49,907 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:14:49,907 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:49,907 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. started... 2023-07-12 16:14:49,907 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. 2023-07-12 16:14:49,907 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,907 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:14:49,909 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 634adfda451d238a3bdee5be9f0a90c9: 2023-07-12 16:14:49,909 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,909 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:49,909 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:14:49,907 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. started... 2023-07-12 16:14:49,907 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:49,911 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1746e922c35deaba21101a66979edb45: 2023-07-12 16:14:49,912 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,912 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 16:14:49,912 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:49,912 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:49,912 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:14:49,912 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 16:14:49,935 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. completed. 2023-07-12 16:14:49,935 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:14:49,935 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:49,935 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:49,935 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,935 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 16:14:49,935 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,45885,1689178459339' in zk 2023-07-12 16:14:49,937 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,937 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 16:14:49,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:49,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:49,938 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. completed. 2023-07-12 16:14:49,938 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:49,938 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. 2023-07-12 16:14:49,938 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 16:14:49,944 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:49,944 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:49,944 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,944 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 16:14:49,944 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,36809,1689178459409' in zk 2023-07-12 16:14:49,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:49,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:49,946 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 16:14:49,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,946 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:49,946 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 16:14:49,948 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:49,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:49,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:49,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase5.apache.org,45885,1689178459339': 2023-07-12 16:14:49,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 16:14:49,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:49,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:49,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:49,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:49,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:49,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase5.apache.org,36809,1689178459409': 2023-07-12 16:14:49,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 16:14:49,955 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-12 16:14:49,955 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:14:49,955 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:14:49,955 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,955 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:14:49,957 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,957 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,957 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:49,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,957 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,957 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:49,957 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,958 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:49,958 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:49,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:49,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:49,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:49,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:49,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:49,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:49,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:49,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:49,959 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:49,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,959 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:49,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:49,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,962 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:49,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,962 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:49,962 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:49,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,967 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,968 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,968 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,968 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:49,968 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,968 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:49,968 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:49,968 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:49,968 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:49,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:49,968 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:49,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:49,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:49,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:49,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:49,968 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:49,968 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:49,968 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:49,968 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:49,968 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:49,969 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:49,968 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,970 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,970 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:49,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:49,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:49,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:49,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:49,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:49,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:49,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,016 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 16:14:50,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,016 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689178489444Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689178489970 (+526 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689178489970Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689178489975 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689178489985 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689178490016 (+31 ms) 2023-07-12 16:14:50,019 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 16:14:50,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 574 msec 2023-07-12 16:14:50,049 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:50,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:14:50,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:14:50,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:14:50,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36809] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:14:50,067 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 16:14:50,067 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:14:50,067 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:14:50,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:14:50,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178490080 (current time:1689178490080). 2023-07-12 16:14:50,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:14:50,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x7b01be76 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:50,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f33d8ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:50,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:50,093 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:45856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:50,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b01be76 to 127.0.0.1:62419 2023-07-12 16:14:50,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:50,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x1868d385 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:50,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f3b6f39, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:50,108 DEBUG [hconnection-0x63de8c71-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:50,109 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:45860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:50,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1868d385 to 127.0.0.1:62419 2023-07-12 16:14:50,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:50,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 16:14:50,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:14:50,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:14:50,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:14:50,123 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:14:50,124 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689179090124 2023-07-12 16:14:50,124 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 16:14:50,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:14:50,126 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:14:50,126 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:14:50,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 16:14:50,127 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:14:50,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-12 16:14:50,130 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 16:14:50,130 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689179090130 2023-07-12 16:14:50,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-12 16:14:50,151 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-12 16:14:50,151 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:50,152 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 16:14:50,152 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 16:14:50,153 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,153 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,154 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:50,154 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:50,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:50,154 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,154 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:50,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:50,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:50,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:50,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:50,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:50,155 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,155 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,156 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,156 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:14:50,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 16:14:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 16:14:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 16:14:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 16:14:50,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 16:14:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,157 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 16:14:50,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 16:14:50,157 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 16:14:50,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 16:14:50,157 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:50,157 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 16:14:50,158 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 16:14:50,158 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 16:14:50,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 16:14:50,158 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 16:14:50,158 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:50,159 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 16:14:50,160 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:50,160 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 16:14:50,161 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 16:14:50,161 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 16:14:50,161 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 16:14:50,161 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 16:14:50,161 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 16:14:50,162 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,162 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:50,163 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,163 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,163 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,163 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:50,165 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,165 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:50,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:50,165 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:50,166 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,166 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:50,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:50,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:50,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:50,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 16:14:50,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66deb630[Count = 1] remaining members to acquire global barrier 2023-07-12 16:14:50,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:50,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:50,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:50,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:50,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:50,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:50,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:50,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 16:14:50,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66deb630[Count = 0] remaining members to acquire global barrier 2023-07-12 16:14:50,171 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 16:14:50,171 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,172 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,172 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,172 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,172 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:14:50,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,173 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:14:50,173 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:14:50,172 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,172 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 16:14:50,173 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,38727,1689178459459' in zk 2023-07-12 16:14:50,173 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:50,173 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:50,173 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:50,173 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:50,173 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. 2023-07-12 16:14:50,173 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:14:50,173 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. started... 2023-07-12 16:14:50,173 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,173 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:14:50,173 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. started... 2023-07-12 16:14:50,173 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1746e922c35deaba21101a66979edb45 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-12 16:14:50,174 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 634adfda451d238a3bdee5be9f0a90c9 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-12 16:14:50,175 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 16:14:50,175 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:50,175 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 16:14:50,214 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/.tmp/cf/ee984eee671a49f08cb07a683c25638d 2023-07-12 16:14:50,215 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/.tmp/cf/9a895040f6b546a68bfb26e3dab57b77 2023-07-12 16:14:50,226 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:50,226 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/.tmp/cf/ee984eee671a49f08cb07a683c25638d as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/cf/ee984eee671a49f08cb07a683c25638d 2023-07-12 16:14:50,226 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/.tmp/cf/9a895040f6b546a68bfb26e3dab57b77 as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/cf/9a895040f6b546a68bfb26e3dab57b77 2023-07-12 16:14:50,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:14:50,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:14:50,231 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:14:50,237 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/cf/ee984eee671a49f08cb07a683c25638d, entries=4, sequenceid=6, filesize=5.1 K 2023-07-12 16:14:50,260 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 634adfda451d238a3bdee5be9f0a90c9 in 87ms, sequenceid=6, compaction requested=false 2023-07-12 16:14:50,260 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-12 16:14:50,262 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 634adfda451d238a3bdee5be9f0a90c9: 2023-07-12 16:14:50,262 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/cf/9a895040f6b546a68bfb26e3dab57b77, entries=46, sequenceid=6, filesize=7.9 K 2023-07-12 16:14:50,262 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 16:14:50,262 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:50,262 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/cf/ee984eee671a49f08cb07a683c25638d] hfiles 2023-07-12 16:14:50,263 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/cf/ee984eee671a49f08cb07a683c25638d for snapshot=snaptb0-testExportFileSystemState 2023-07-12 16:14:50,264 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 1746e922c35deaba21101a66979edb45 in 91ms, sequenceid=6, compaction requested=false 2023-07-12 16:14:50,266 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1746e922c35deaba21101a66979edb45: 2023-07-12 16:14:50,266 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 16:14:50,266 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:50,266 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/cf/9a895040f6b546a68bfb26e3dab57b77] hfiles 2023-07-12 16:14:50,266 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/cf/9a895040f6b546a68bfb26e3dab57b77 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 16:14:50,299 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. completed. 2023-07-12 16:14:50,299 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:14:50,299 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:50,299 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:50,299 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. completed. 2023-07-12 16:14:50,299 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,299 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. 2023-07-12 16:14:50,299 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 16:14:50,299 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:50,299 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:50,299 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,45885,1689178459339' in zk 2023-07-12 16:14:50,300 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,300 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 16:14:50,300 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,36809,1689178459409' in zk 2023-07-12 16:14:50,307 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 16:14:50,307 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,307 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:50,307 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:50,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:50,307 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 16:14:50,307 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 16:14:50,308 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:50,308 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 16:14:50,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:50,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:50,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:50,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:50,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:50,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:50,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:50,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase5.apache.org,36809,1689178459409': 2023-07-12 16:14:50,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 16:14:50,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:50,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:50,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:50,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:50,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:50,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:50,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase5.apache.org,45885,1689178459339': 2023-07-12 16:14:50,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 16:14:50,316 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-12 16:14:50,316 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:14:50,316 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:14:50,316 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-12 16:14:50,316 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:14:50,317 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,317 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,318 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,318 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,318 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,318 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,318 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:50,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:50,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:50,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:50,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:50,319 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:50,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:50,319 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:50,320 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:50,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:50,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:50,322 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:50,323 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:50,323 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,327 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:50,327 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:50,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:50,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:50,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:50,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:50,327 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:50,327 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:50,327 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:50,327 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,327 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:50,327 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:50,327 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:50,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:50,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:50,327 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-12 16:14:50,327 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-12 16:14:50,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:50,329 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:50,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:50,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:50,329 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,329 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:14:50,330 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,330 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:14:50,330 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:14:50,330 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,330 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:50,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:50,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 16:14:50,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,375 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689178490124Consolidate snapshot: snaptb0-testExportFileSystemState at 1689178490329 (+205 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689178490329Writing data manifest for snaptb0-testExportFileSystemState at 1689178490334 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689178490343 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689178490375 (+32 ms) 2023-07-12 16:14:50,378 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 16:14:50,380 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 253 msec 2023-07-12 16:14:50,451 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:50,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:14:50,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:14:50,454 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178490454 2023-07-12 16:14:50,454 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39241, tgtDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178490454, rawTgtDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178490454, srcFsUri=hdfs://localhost:39241, srcDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:14:50,479 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39241, inputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:14:50,479 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1055228601_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178490454, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178490454/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,479 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39241, inputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca, snapshotDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-12 16:14:50,490 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178490454/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 16:14:50,522 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:50,522 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:50,523 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:50,523 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:51,538 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop-2383477882424015971.jar 2023-07-12 16:14:51,538 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:51,539 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:51,605 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop-8302965029990715664.jar 2023-07-12 16:14:51,606 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:51,606 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:51,607 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:51,607 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:51,608 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:51,608 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:51,608 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 16:14:51,609 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 16:14:51,609 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 16:14:51,609 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 16:14:51,610 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 16:14:51,610 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 16:14:51,611 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 16:14:51,611 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 16:14:51,611 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 16:14:51,612 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 16:14:51,612 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:51,613 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:51,614 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:14:51,614 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:51,614 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:51,615 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:14:51,616 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:14:52,148 WARN [Listener at jenkins-hbase5.apache.org/43841] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 16:14:52,151 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-12 16:14:52,153 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 16:14:52,970 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:14:52,970 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:14:52,979 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0001_000001 (auth:SIMPLE) 2023-07-12 16:14:53,517 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0002_000001 (auth:SIMPLE) 2023-07-12 16:14:53,956 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:14:58,156 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0002_000001 (auth:SIMPLE) 2023-07-12 16:15:00,379 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0002_000001 (auth:SIMPLE) 2023-07-12 16:15:03,097 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0002_000001 (auth:SIMPLE) 2023-07-12 16:15:04,374 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 16:15:04,375 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 16:15:04,383 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-12 16:15:04,383 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 16:15:04,383 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 16:15:04,384 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1856420832_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 16:15:04,384 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 16:15:04,384 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 16:15:04,384 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1856420832_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178490454/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178490454/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 16:15:04,385 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178490454/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 16:15:04,385 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178490454/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 16:15:04,396 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-12 16:15:04,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testExportFileSystemState 2023-07-12 16:15:04,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:15:04,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 16:15:04,406 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178504406"}]},"ts":"1689178504406"} 2023-07-12 16:15:04,408 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 16:15:04,410 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-12 16:15:04,411 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=634adfda451d238a3bdee5be9f0a90c9, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1746e922c35deaba21101a66979edb45, UNASSIGN}] 2023-07-12 16:15:04,414 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=634adfda451d238a3bdee5be9f0a90c9, UNASSIGN 2023-07-12 16:15:04,414 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1746e922c35deaba21101a66979edb45, UNASSIGN 2023-07-12 16:15:04,415 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=634adfda451d238a3bdee5be9f0a90c9, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:04,415 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178504415"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178504415"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178504415"}]},"ts":"1689178504415"} 2023-07-12 16:15:04,415 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=1746e922c35deaba21101a66979edb45, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:04,415 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178504415"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178504415"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178504415"}]},"ts":"1689178504415"} 2023-07-12 16:15:04,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 634adfda451d238a3bdee5be9f0a90c9, server=jenkins-hbase5.apache.org,45885,1689178459339}] 2023-07-12 16:15:04,418 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 1746e922c35deaba21101a66979edb45, server=jenkins-hbase5.apache.org,36809,1689178459409}] 2023-07-12 16:15:04,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 16:15:04,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 634adfda451d238a3bdee5be9f0a90c9 2023-07-12 16:15:04,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 634adfda451d238a3bdee5be9f0a90c9, disabling compactions & flushes 2023-07-12 16:15:04,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:15:04,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:15:04,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. after waiting 0 ms 2023-07-12 16:15:04,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:15:04,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 1746e922c35deaba21101a66979edb45 2023-07-12 16:15:04,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1746e922c35deaba21101a66979edb45, disabling compactions & flushes 2023-07-12 16:15:04,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. 2023-07-12 16:15:04,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. 2023-07-12 16:15:04,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. after waiting 0 ms 2023-07-12 16:15:04,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. 2023-07-12 16:15:04,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:15:04,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:15:04,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:15:04,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:15:04,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45. 2023-07-12 16:15:04,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9. 2023-07-12 16:15:04,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1746e922c35deaba21101a66979edb45: 2023-07-12 16:15:04,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 634adfda451d238a3bdee5be9f0a90c9: 2023-07-12 16:15:04,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 1746e922c35deaba21101a66979edb45 2023-07-12 16:15:04,594 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=1746e922c35deaba21101a66979edb45, regionState=CLOSED 2023-07-12 16:15:04,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 634adfda451d238a3bdee5be9f0a90c9 2023-07-12 16:15:04,594 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178504594"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178504594"}]},"ts":"1689178504594"} 2023-07-12 16:15:04,595 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=634adfda451d238a3bdee5be9f0a90c9, regionState=CLOSED 2023-07-12 16:15:04,595 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178504594"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178504594"}]},"ts":"1689178504594"} 2023-07-12 16:15:04,598 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-12 16:15:04,598 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 1746e922c35deaba21101a66979edb45, server=jenkins-hbase5.apache.org,36809,1689178459409 in 178 msec 2023-07-12 16:15:04,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-12 16:15:04,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 634adfda451d238a3bdee5be9f0a90c9, server=jenkins-hbase5.apache.org,45885,1689178459339 in 180 msec 2023-07-12 16:15:04,600 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1746e922c35deaba21101a66979edb45, UNASSIGN in 187 msec 2023-07-12 16:15:04,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-12 16:15:04,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=634adfda451d238a3bdee5be9f0a90c9, UNASSIGN in 188 msec 2023-07-12 16:15:04,602 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178504602"}]},"ts":"1689178504602"} 2023-07-12 16:15:04,603 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 16:15:04,605 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-12 16:15:04,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 210 msec 2023-07-12 16:15:04,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 16:15:04,708 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-12 16:15:04,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testExportFileSystemState 2023-07-12 16:15:04,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:15:04,712 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:15:04,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-12 16:15:04,713 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:15:04,715 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38727] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-12 16:15:04,718 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9 2023-07-12 16:15:04,718 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45 2023-07-12 16:15:04,721 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/cf, FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/recovered.edits] 2023-07-12 16:15:04,721 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/cf, FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/recovered.edits] 2023-07-12 16:15:04,723 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:04,723 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:04,724 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 16:15:04,724 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 16:15:04,725 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:04,725 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:04,726 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 16:15:04,726 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 16:15:04,726 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/cf/ee984eee671a49f08cb07a683c25638d to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/cf/ee984eee671a49f08cb07a683c25638d 2023-07-12 16:15:04,727 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/cf/9a895040f6b546a68bfb26e3dab57b77 to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/cf/9a895040f6b546a68bfb26e3dab57b77 2023-07-12 16:15:04,727 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:04,727 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:04,727 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:04,727 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:04,727 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:04,727 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:04,727 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:04,727 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:04,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 16:15:04,731 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/recovered.edits/9.seqid to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9/recovered.edits/9.seqid 2023-07-12 16:15:04,731 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/recovered.edits/9.seqid to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45/recovered.edits/9.seqid 2023-07-12 16:15:04,731 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/634adfda451d238a3bdee5be9f0a90c9 2023-07-12 16:15:04,731 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemState/1746e922c35deaba21101a66979edb45 2023-07-12 16:15:04,732 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 16:15:04,734 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:15:04,737 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-12 16:15:04,739 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-12 16:15:04,740 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:15:04,740 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-12 16:15:04,740 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178504740"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:04,740 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178504740"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:04,742 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 16:15:04,742 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 634adfda451d238a3bdee5be9f0a90c9, NAME => 'testtb-testExportFileSystemState,,1689178488679.634adfda451d238a3bdee5be9f0a90c9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1746e922c35deaba21101a66979edb45, NAME => 'testtb-testExportFileSystemState,1,1689178488679.1746e922c35deaba21101a66979edb45.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 16:15:04,743 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-12 16:15:04,743 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689178504743"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:04,744 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-12 16:15:04,746 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:15:04,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 38 msec 2023-07-12 16:15:04,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 16:15:04,830 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-12 16:15:04,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-12 16:15:04,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-12 16:15:04,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-12 16:15:04,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-12 16:15:04,869 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=767 (was 757) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1856420832_17 at /127.0.0.1:60944 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_594670365_1 at /127.0.0.1:39660 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1856420832_17 at /127.0.0.1:44516 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1952 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase5.apache.org/172.31.10.131:43949 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase5.apache.org/172.31.10.131:38913 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1856420832_17 at /127.0.0.1:39682 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=374 (was 288) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=3714 (was 4404) 2023-07-12 16:15:04,869 WARN [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-12 16:15:04,889 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=767, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=374, ProcessCount=171, AvailableMemoryMB=3714 2023-07-12 16:15:04,889 WARN [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-12 16:15:04,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 16:15:04,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:04,895 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:15:04,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-12 16:15:04,896 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:15:04,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 16:15:04,899 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943 2023-07-12 16:15:04,899 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed 2023-07-12 16:15:04,900 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943 empty. 2023-07-12 16:15:04,900 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed empty. 2023-07-12 16:15:04,900 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943 2023-07-12 16:15:04,901 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed 2023-07-12 16:15:04,901 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 16:15:04,927 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-12 16:15:04,928 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 33d1b7b33c7f685fd26f045914bbb943, NAME => 'testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:15:04,928 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => b1a8b21c9def6c16dd4fd64c8b523eed, NAME => 'testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:15:04,973 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:04,973 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 33d1b7b33c7f685fd26f045914bbb943, disabling compactions & flushes 2023-07-12 16:15:04,973 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:04,973 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:04,973 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. after waiting 0 ms 2023-07-12 16:15:04,973 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:04,974 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:04,974 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 33d1b7b33c7f685fd26f045914bbb943: 2023-07-12 16:15:04,976 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:04,977 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing b1a8b21c9def6c16dd4fd64c8b523eed, disabling compactions & flushes 2023-07-12 16:15:04,977 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. 2023-07-12 16:15:04,977 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. 2023-07-12 16:15:04,977 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. after waiting 0 ms 2023-07-12 16:15:04,977 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. 2023-07-12 16:15:04,977 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. 2023-07-12 16:15:04,977 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for b1a8b21c9def6c16dd4fd64c8b523eed: 2023-07-12 16:15:04,981 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:15:04,982 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178504981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178504981"}]},"ts":"1689178504981"} 2023-07-12 16:15:04,982 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178504981"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178504981"}]},"ts":"1689178504981"} 2023-07-12 16:15:04,985 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 16:15:04,986 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:15:04,986 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178504986"}]},"ts":"1689178504986"} 2023-07-12 16:15:04,988 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-12 16:15:04,992 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:15:04,993 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:15:04,994 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:15:04,994 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:15:04,994 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:15:04,994 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=33d1b7b33c7f685fd26f045914bbb943, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1a8b21c9def6c16dd4fd64c8b523eed, ASSIGN}] 2023-07-12 16:15:05,001 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1a8b21c9def6c16dd4fd64c8b523eed, ASSIGN 2023-07-12 16:15:05,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 16:15:05,002 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=33d1b7b33c7f685fd26f045914bbb943, ASSIGN 2023-07-12 16:15:05,002 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1a8b21c9def6c16dd4fd64c8b523eed, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,36809,1689178459409; forceNewPlan=false, retain=false 2023-07-12 16:15:05,003 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=33d1b7b33c7f685fd26f045914bbb943, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,45885,1689178459339; forceNewPlan=false, retain=false 2023-07-12 16:15:05,152 INFO [jenkins-hbase5:41835] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 16:15:05,155 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=33d1b7b33c7f685fd26f045914bbb943, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,155 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b1a8b21c9def6c16dd4fd64c8b523eed, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,155 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178505155"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178505155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178505155"}]},"ts":"1689178505155"} 2023-07-12 16:15:05,155 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178505155"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178505155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178505155"}]},"ts":"1689178505155"} 2023-07-12 16:15:05,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 33d1b7b33c7f685fd26f045914bbb943, server=jenkins-hbase5.apache.org,45885,1689178459339}] 2023-07-12 16:15:05,159 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure b1a8b21c9def6c16dd4fd64c8b523eed, server=jenkins-hbase5.apache.org,36809,1689178459409}] 2023-07-12 16:15:05,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 16:15:05,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:05,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 33d1b7b33c7f685fd26f045914bbb943, NAME => 'testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 16:15:05,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. service=AccessControlService 2023-07-12 16:15:05,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:15:05,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 33d1b7b33c7f685fd26f045914bbb943 2023-07-12 16:15:05,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:05,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 33d1b7b33c7f685fd26f045914bbb943 2023-07-12 16:15:05,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 33d1b7b33c7f685fd26f045914bbb943 2023-07-12 16:15:05,315 INFO [StoreOpener-33d1b7b33c7f685fd26f045914bbb943-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 33d1b7b33c7f685fd26f045914bbb943 2023-07-12 16:15:05,317 DEBUG [StoreOpener-33d1b7b33c7f685fd26f045914bbb943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/cf 2023-07-12 16:15:05,317 DEBUG [StoreOpener-33d1b7b33c7f685fd26f045914bbb943-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/cf 2023-07-12 16:15:05,317 INFO [StoreOpener-33d1b7b33c7f685fd26f045914bbb943-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33d1b7b33c7f685fd26f045914bbb943 columnFamilyName cf 2023-07-12 16:15:05,318 INFO [StoreOpener-33d1b7b33c7f685fd26f045914bbb943-1] regionserver.HStore(310): Store=33d1b7b33c7f685fd26f045914bbb943/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:15:05,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943 2023-07-12 16:15:05,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943 2023-07-12 16:15:05,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. 2023-07-12 16:15:05,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b1a8b21c9def6c16dd4fd64c8b523eed, NAME => 'testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 16:15:05,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. service=AccessControlService 2023-07-12 16:15:05,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:15:05,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b1a8b21c9def6c16dd4fd64c8b523eed 2023-07-12 16:15:05,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:05,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for b1a8b21c9def6c16dd4fd64c8b523eed 2023-07-12 16:15:05,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for b1a8b21c9def6c16dd4fd64c8b523eed 2023-07-12 16:15:05,322 INFO [StoreOpener-b1a8b21c9def6c16dd4fd64c8b523eed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b1a8b21c9def6c16dd4fd64c8b523eed 2023-07-12 16:15:05,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 33d1b7b33c7f685fd26f045914bbb943 2023-07-12 16:15:05,324 DEBUG [StoreOpener-b1a8b21c9def6c16dd4fd64c8b523eed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/cf 2023-07-12 16:15:05,324 DEBUG [StoreOpener-b1a8b21c9def6c16dd4fd64c8b523eed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/cf 2023-07-12 16:15:05,324 INFO [StoreOpener-b1a8b21c9def6c16dd4fd64c8b523eed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1a8b21c9def6c16dd4fd64c8b523eed columnFamilyName cf 2023-07-12 16:15:05,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:15:05,325 INFO [StoreOpener-b1a8b21c9def6c16dd4fd64c8b523eed-1] regionserver.HStore(310): Store=b1a8b21c9def6c16dd4fd64c8b523eed/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:15:05,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 33d1b7b33c7f685fd26f045914bbb943; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65350311, jitterRate=-0.026204481720924377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:15:05,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 33d1b7b33c7f685fd26f045914bbb943: 2023-07-12 16:15:05,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed 2023-07-12 16:15:05,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943., pid=45, masterSystemTime=1689178505310 2023-07-12 16:15:05,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed 2023-07-12 16:15:05,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:05,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:05,329 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=33d1b7b33c7f685fd26f045914bbb943, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,329 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178505329"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178505329"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178505329"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178505329"}]},"ts":"1689178505329"} 2023-07-12 16:15:05,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for b1a8b21c9def6c16dd4fd64c8b523eed 2023-07-12 16:15:05,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:15:05,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened b1a8b21c9def6c16dd4fd64c8b523eed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61301451, jitterRate=-0.0865371972322464}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:15:05,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-12 16:15:05,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for b1a8b21c9def6c16dd4fd64c8b523eed: 2023-07-12 16:15:05,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 33d1b7b33c7f685fd26f045914bbb943, server=jenkins-hbase5.apache.org,45885,1689178459339 in 173 msec 2023-07-12 16:15:05,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed., pid=46, masterSystemTime=1689178505317 2023-07-12 16:15:05,335 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=33d1b7b33c7f685fd26f045914bbb943, ASSIGN in 339 msec 2023-07-12 16:15:05,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. 2023-07-12 16:15:05,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. 2023-07-12 16:15:05,336 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b1a8b21c9def6c16dd4fd64c8b523eed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,336 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178505336"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178505336"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178505336"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178505336"}]},"ts":"1689178505336"} 2023-07-12 16:15:05,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-12 16:15:05,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure b1a8b21c9def6c16dd4fd64c8b523eed, server=jenkins-hbase5.apache.org,36809,1689178459409 in 179 msec 2023-07-12 16:15:05,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-12 16:15:05,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1a8b21c9def6c16dd4fd64c8b523eed, ASSIGN in 346 msec 2023-07-12 16:15:05,343 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:15:05,343 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178505343"}]},"ts":"1689178505343"} 2023-07-12 16:15:05,344 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-12 16:15:05,347 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:15:05,347 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-12 16:15:05,350 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38727] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 16:15:05,352 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:05,352 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:05,352 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:05,352 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:05,353 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:05,353 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:05,353 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:05,353 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:05,355 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 462 msec 2023-07-12 16:15:05,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 16:15:05,504 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-12 16:15:05,505 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-12 16:15:05,505 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:15:05,508 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-12 16:15:05,508 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:15:05,508 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-12 16:15:05,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 16:15:05,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178505511 (current time:1689178505511). 2023-07-12 16:15:05,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:15:05,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x5d957038 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:05,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2db0a511, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:05,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:05,522 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:05,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d957038 to 127.0.0.1:62419 2023-07-12 16:15:05,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:05,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x1f957a0a to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:05,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69f7cd70, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:05,529 DEBUG [hconnection-0x41476572-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:05,532 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:05,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f957a0a to 127.0.0.1:62419 2023-07-12 16:15:05,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:05,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 16:15:05,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:15:05,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 16:15:05,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 16:15:05,540 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 16:15:05,541 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689179105541 2023-07-12 16:15:05,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 16:15:05,541 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 16:15:05,542 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:15:05,542 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:15:05,543 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 16:15:05,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 16:15:05,544 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-12 16:15:05,545 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 16:15:05,545 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689179105545 2023-07-12 16:15:05,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,556 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-12 16:15:05,556 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:05,557 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 16:15:05,557 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 16:15:05,557 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,558 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,559 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:05,559 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:05,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:05,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:05,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:05,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:05,559 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:05,559 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:05,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:05,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,560 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,560 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,561 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,561 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:15:05,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 16:15:05,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 16:15:05,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,561 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 16:15:05,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 16:15:05,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,561 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 16:15:05,561 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 16:15:05,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,561 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 16:15:05,562 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 16:15:05,562 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:05,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,563 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 16:15:05,563 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 16:15:05,563 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:05,562 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:05,564 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 16:15:05,566 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 16:15:05,566 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 16:15:05,566 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 16:15:05,563 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 16:15:05,566 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 16:15:05,567 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 16:15:05,567 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 16:15:05,569 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,569 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:05,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:05,570 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,570 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,570 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:05,570 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,570 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:05,570 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,570 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,571 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:05,570 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:05,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:05,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:05,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:05,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 16:15:05,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b0e7fb7[Count = 1] remaining members to acquire global barrier 2023-07-12 16:15:05,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:05,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:05,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:05,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:05,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 16:15:05,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b0e7fb7[Count = 0] remaining members to acquire global barrier 2023-07-12 16:15:05,575 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 16:15:05,575 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,576 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,576 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,576 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,577 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 16:15:05,577 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 16:15:05,577 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,577 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 16:15:05,577 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:05,577 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:05,577 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,38727,1689178459459' in zk 2023-07-12 16:15:05,577 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 16:15:05,577 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:05,577 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. started... 2023-07-12 16:15:05,577 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,577 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:15:05,577 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. 2023-07-12 16:15:05,577 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:05,579 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:05,579 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. started... 2023-07-12 16:15:05,578 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 33d1b7b33c7f685fd26f045914bbb943: 2023-07-12 16:15:05,580 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1a8b21c9def6c16dd4fd64c8b523eed: 2023-07-12 16:15:05,580 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,581 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:05,581 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,581 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:15:05,581 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:05,581 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:15:05,588 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 16:15:05,588 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:05,588 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 16:15:05,607 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. completed. 2023-07-12 16:15:05,607 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:05,607 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:05,607 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:05,607 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,607 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 16:15:05,607 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,45885,1689178459339' in zk 2023-07-12 16:15:05,609 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,609 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 16:15:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:05,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:05,609 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:05,609 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 16:15:05,610 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. completed. 2023-07-12 16:15:05,610 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. 2023-07-12 16:15:05,611 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:05,611 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:05,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:05,611 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,611 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 16:15:05,611 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,36809,1689178459409' in zk 2023-07-12 16:15:05,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:05,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,613 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,613 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 16:15:05,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:05,613 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:05,613 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 16:15:05,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:05,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase5.apache.org,45885,1689178459339': 2023-07-12 16:15:05,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 16:15:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:05,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:05,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:05,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:05,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase5.apache.org,36809,1689178459409': 2023-07-12 16:15:05,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 16:15:05,620 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-12 16:15:05,620 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:15:05,620 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:15:05,620 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,620 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:15:05,622 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,622 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,622 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:05,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,622 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,623 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:05,623 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,623 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:05,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:05,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:05,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:05,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:05,623 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:05,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:05,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,624 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:05,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:05,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:05,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:05,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,624 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:05,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:05,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,628 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:05,628 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,629 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:05,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,633 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,633 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,633 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:05,633 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,633 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:05,633 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:05,633 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:05,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:05,633 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:05,633 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:05,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,634 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:05,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:05,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:05,633 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:05,634 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:05,633 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:05,635 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:05,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:05,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:05,635 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:05,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:05,635 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:05,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,635 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:05,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:05,635 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,642 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:05,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 16:15:05,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:15:05,643 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:15:05,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,684 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 16:15:05,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,684 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:05,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689178505541Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689178505634 (+93 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689178505634Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689178505638 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689178505653 (+15 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689178505684 (+31 ms) 2023-07-12 16:15:05,687 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 16:15:05,689 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 145 msec 2023-07-12 16:15:05,843 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:05,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 16:15:05,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:15:05,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:15:05,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36809] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:15:05,856 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 16:15:05,857 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:05,857 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:15:05,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 16:15:05,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178505872 (current time:1689178505872). 2023-07-12 16:15:05,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:15:05,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x652ab02e to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:05,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d1f495a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:05,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:05,889 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:05,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x652ab02e to 127.0.0.1:62419 2023-07-12 16:15:05,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:05,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x5353ef59 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:05,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63c88edd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:05,899 DEBUG [hconnection-0x47a4e67-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:05,901 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:05,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5353ef59 to 127.0.0.1:62419 2023-07-12 16:15:05,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:05,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 16:15:05,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:15:05,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 16:15:05,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 16:15:05,911 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 16:15:05,912 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689179105912 2023-07-12 16:15:05,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 16:15:05,912 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 16:15:05,913 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:15:05,913 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:15:05,914 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 16:15:05,914 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 16:15:05,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-12 16:15:05,916 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 16:15:05,917 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689179105917 2023-07-12 16:15:05,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-12 16:15:05,926 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-12 16:15:05,927 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:05,928 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 16:15:05,928 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 16:15:05,928 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,928 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,930 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:05,930 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:05,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:05,930 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:05,930 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:05,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:05,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:05,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:05,930 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,930 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:05,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,931 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,931 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:15:05,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 16:15:05,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,931 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 16:15:05,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 16:15:05,932 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 16:15:05,932 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:05,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 16:15:05,933 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 16:15:05,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 16:15:05,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,933 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 16:15:05,933 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 16:15:05,933 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 16:15:05,933 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 16:15:05,933 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 16:15:05,934 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 16:15:05,934 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 16:15:05,934 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:05,934 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 16:15:05,935 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:05,935 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 16:15:05,936 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 16:15:05,936 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 16:15:05,936 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 16:15:05,936 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 16:15:05,936 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 16:15:05,937 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,937 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:05,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:05,938 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,940 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,940 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,940 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,940 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:05,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:05,940 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:05,940 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:05,941 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,941 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:05,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:05,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:05,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:05,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 16:15:05,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@605d190f[Count = 1] remaining members to acquire global barrier 2023-07-12 16:15:05,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:05,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:05,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:05,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:05,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:05,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:05,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:05,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 16:15:05,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@605d190f[Count = 0] remaining members to acquire global barrier 2023-07-12 16:15:05,944 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 16:15:05,944 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,945 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,945 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,946 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,946 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 16:15:05,946 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 16:15:05,946 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:05,946 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 16:15:05,946 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 16:15:05,946 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:05,946 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:05,946 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:05,946 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. 2023-07-12 16:15:05,946 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. started... 2023-07-12 16:15:05,946 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. started... 2023-07-12 16:15:05,946 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,38727,1689178459459' in zk 2023-07-12 16:15:05,946 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,946 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:15:05,946 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:05,946 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:05,947 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 33d1b7b33c7f685fd26f045914bbb943 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-12 16:15:05,947 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b1a8b21c9def6c16dd4fd64c8b523eed 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-12 16:15:05,948 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 16:15:05,948 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:05,948 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 16:15:05,964 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/.tmp/cf/eef548040eb74bdab94bd3b717ee0da3 2023-07-12 16:15:05,965 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/.tmp/cf/6bc412d9677b474e839a3e6d6a53fb02 2023-07-12 16:15:05,970 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/.tmp/cf/6bc412d9677b474e839a3e6d6a53fb02 as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/cf/6bc412d9677b474e839a3e6d6a53fb02 2023-07-12 16:15:05,972 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/.tmp/cf/eef548040eb74bdab94bd3b717ee0da3 as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/cf/eef548040eb74bdab94bd3b717ee0da3 2023-07-12 16:15:05,976 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/cf/6bc412d9677b474e839a3e6d6a53fb02, entries=46, sequenceid=6, filesize=7.9 K 2023-07-12 16:15:05,977 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for b1a8b21c9def6c16dd4fd64c8b523eed in 30ms, sequenceid=6, compaction requested=false 2023-07-12 16:15:05,977 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 16:15:05,977 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/cf/eef548040eb74bdab94bd3b717ee0da3, entries=4, sequenceid=6, filesize=5.1 K 2023-07-12 16:15:05,978 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1a8b21c9def6c16dd4fd64c8b523eed: 2023-07-12 16:15:05,978 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 16:15:05,978 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:05,978 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/cf/6bc412d9677b474e839a3e6d6a53fb02] hfiles 2023-07-12 16:15:05,978 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/cf/6bc412d9677b474e839a3e6d6a53fb02 for snapshot=snaptb0-testConsecutiveExports 2023-07-12 16:15:05,978 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 33d1b7b33c7f685fd26f045914bbb943 in 32ms, sequenceid=6, compaction requested=false 2023-07-12 16:15:05,980 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 33d1b7b33c7f685fd26f045914bbb943: 2023-07-12 16:15:05,980 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 16:15:05,980 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:05,980 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/cf/eef548040eb74bdab94bd3b717ee0da3] hfiles 2023-07-12 16:15:05,980 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/cf/eef548040eb74bdab94bd3b717ee0da3 for snapshot=snaptb0-testConsecutiveExports 2023-07-12 16:15:05,992 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. completed. 2023-07-12 16:15:05,992 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. 2023-07-12 16:15:05,992 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:05,992 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:05,992 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,992 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 16:15:05,992 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,36809,1689178459409' in zk 2023-07-12 16:15:05,993 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. completed. 2023-07-12 16:15:05,993 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:05,993 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:05,993 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:05,993 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:05,993 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 16:15:05,993 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,45885,1689178459339' in zk 2023-07-12 16:15:05,994 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,994 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 16:15:05,994 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:05,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:05,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:05,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:05,994 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 16:15:06,000 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 16:15:06,000 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:06,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:06,000 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:06,000 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 16:15:06,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:06,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:06,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:06,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:06,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:06,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:06,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:06,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:06,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:06,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:06,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase5.apache.org,36809,1689178459409': 2023-07-12 16:15:06,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 16:15:06,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:06,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:06,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:06,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:06,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:06,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:06,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:06,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:06,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:06,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:06,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:06,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:06,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase5.apache.org,45885,1689178459339': 2023-07-12 16:15:06,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 16:15:06,008 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-12 16:15:06,008 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:15:06,008 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:15:06,008 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-12 16:15:06,008 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:15:06,010 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,010 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,010 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,010 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,010 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:06,010 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:06,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,010 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:06,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:06,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,011 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:06,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:06,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:06,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:06,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:06,012 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:06,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:06,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,012 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:06,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:06,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:06,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:06,013 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:06,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:06,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:06,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 16:15:06,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:15:06,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:06,015 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:15:06,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:06,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:06,015 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:06,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:06,016 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:06,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:06,016 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:06,021 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:06,022 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:06,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:06,022 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:06,021 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:06,022 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:06,021 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:06,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:06,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:06,022 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-12 16:15:06,022 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:06,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-12 16:15:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:06,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:06,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:06,022 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:06,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:06,023 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:06,024 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:06,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:06,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:06,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:06,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:06,024 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:06,024 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,024 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:06,024 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,025 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:06,025 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:06,025 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,025 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,065 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 16:15:06,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,065 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689178505912Consolidate snapshot: snaptb0-testConsecutiveExports at 1689178506023 (+111 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689178506024 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1689178506027 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689178506039 (+12 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689178506065 (+26 ms) 2023-07-12 16:15:06,068 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 16:15:06,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 155 msec 2023-07-12 16:15:06,215 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:06,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 16:15:06,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:15:06,216 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216 2023-07-12 16:15:06,217 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216, srcFsUri=hdfs://localhost:39241, srcDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:15:06,239 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39241, inputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:15:06,240 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6694eb91, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,240 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39241, inputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca, snapshotDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 16:15:06,247 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 16:15:06,260 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:06,261 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:06,261 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:06,262 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:07,228 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop-8838612555545565664.jar 2023-07-12 16:15:07,229 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:07,229 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:07,307 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop-1766313809986012574.jar 2023-07-12 16:15:07,308 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:07,308 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:07,309 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:07,309 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:07,310 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:07,310 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:07,311 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 16:15:07,311 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 16:15:07,312 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 16:15:07,312 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 16:15:07,313 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 16:15:07,313 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 16:15:07,314 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 16:15:07,314 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 16:15:07,314 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 16:15:07,315 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 16:15:07,316 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:07,316 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:07,317 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:07,317 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:07,318 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:07,318 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:07,319 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:08,148 WARN [Listener at jenkins-hbase5.apache.org/43841] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 16:15:08,151 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 16:15:08,153 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 16:15:09,283 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:15:09,284 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:15:09,286 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0002_000001 (auth:SIMPLE) 2023-07-12 16:15:09,985 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0003_000001 (auth:SIMPLE) 2023-07-12 16:15:10,180 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:15:14,317 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0003_000001 (auth:SIMPLE) 2023-07-12 16:15:16,659 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0003_000001 (auth:SIMPLE) 2023-07-12 16:15:19,343 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0003_000001 (auth:SIMPLE) 2023-07-12 16:15:21,338 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 16:15:21,339 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 16:15:21,343 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 16:15:21,343 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 16:15:21,344 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 16:15:21,345 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1856420832_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 16:15:21,347 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 16:15:21,347 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 16:15:21,347 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6c8d0b08 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 16:15:21,348 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 16:15:21,348 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 16:15:21,349 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216, srcFsUri=hdfs://localhost:39241, srcDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:15:21,377 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39241, inputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:15:21,377 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@21885534, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 16:15:21,377 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39241, inputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca, snapshotDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 16:15:21,392 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 16:15:21,407 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:21,407 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:21,407 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:21,408 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:22,296 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop-1626718826764362074.jar 2023-07-12 16:15:22,297 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:22,297 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:22,364 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop-7890556514687011976.jar 2023-07-12 16:15:22,364 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:22,365 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:22,365 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:22,366 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:22,366 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:22,366 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:22,367 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 16:15:22,367 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 16:15:22,367 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 16:15:22,368 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 16:15:22,368 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 16:15:22,368 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 16:15:22,369 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 16:15:22,369 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 16:15:22,369 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 16:15:22,370 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 16:15:22,371 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:22,371 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:22,372 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:22,372 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:22,372 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:22,372 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:22,373 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:22,745 WARN [Listener at jenkins-hbase5.apache.org/43841] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 16:15:22,748 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 16:15:22,750 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 16:15:25,521 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:15:25,522 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:15:25,524 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0003_000001 (auth:SIMPLE) 2023-07-12 16:15:26,300 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0004_000001 (auth:SIMPLE) 2023-07-12 16:15:30,409 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0004_000001 (auth:SIMPLE) 2023-07-12 16:15:32,696 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0004_000001 (auth:SIMPLE) 2023-07-12 16:15:36,136 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0004_000001 (auth:SIMPLE) 2023-07-12 16:15:37,991 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 16:15:37,991 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 16:15:38,008 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 16:15:38,008 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 16:15:38,008 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 16:15:38,009 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1856420832_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 16:15:38,022 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 16:15:38,023 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 16:15:38,023 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6c8d0b08 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 16:15:38,023 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 16:15:38,023 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/local-export-1689178506216/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 16:15:38,042 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-12 16:15:38,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testConsecutiveExports 2023-07-12 16:15:38,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:38,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 16:15:38,049 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178538049"}]},"ts":"1689178538049"} 2023-07-12 16:15:38,051 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-12 16:15:38,056 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-12 16:15:38,060 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=33d1b7b33c7f685fd26f045914bbb943, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1a8b21c9def6c16dd4fd64c8b523eed, UNASSIGN}] 2023-07-12 16:15:38,067 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=33d1b7b33c7f685fd26f045914bbb943, UNASSIGN 2023-07-12 16:15:38,069 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1a8b21c9def6c16dd4fd64c8b523eed, UNASSIGN 2023-07-12 16:15:38,071 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b1a8b21c9def6c16dd4fd64c8b523eed, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:38,072 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178538071"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178538071"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178538071"}]},"ts":"1689178538071"} 2023-07-12 16:15:38,072 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=33d1b7b33c7f685fd26f045914bbb943, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:38,072 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178538071"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178538071"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178538071"}]},"ts":"1689178538071"} 2023-07-12 16:15:38,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure b1a8b21c9def6c16dd4fd64c8b523eed, server=jenkins-hbase5.apache.org,36809,1689178459409}] 2023-07-12 16:15:38,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 33d1b7b33c7f685fd26f045914bbb943, server=jenkins-hbase5.apache.org,45885,1689178459339}] 2023-07-12 16:15:38,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 16:15:38,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close b1a8b21c9def6c16dd4fd64c8b523eed 2023-07-12 16:15:38,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing b1a8b21c9def6c16dd4fd64c8b523eed, disabling compactions & flushes 2023-07-12 16:15:38,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. 2023-07-12 16:15:38,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. 2023-07-12 16:15:38,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. after waiting 0 ms 2023-07-12 16:15:38,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. 2023-07-12 16:15:38,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 33d1b7b33c7f685fd26f045914bbb943 2023-07-12 16:15:38,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 33d1b7b33c7f685fd26f045914bbb943, disabling compactions & flushes 2023-07-12 16:15:38,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:38,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:38,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. after waiting 0 ms 2023-07-12 16:15:38,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:38,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:15:38,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:15:38,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:15:38,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed. 2023-07-12 16:15:38,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for b1a8b21c9def6c16dd4fd64c8b523eed: 2023-07-12 16:15:38,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:15:38,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943. 2023-07-12 16:15:38,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 33d1b7b33c7f685fd26f045914bbb943: 2023-07-12 16:15:38,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed b1a8b21c9def6c16dd4fd64c8b523eed 2023-07-12 16:15:38,350 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b1a8b21c9def6c16dd4fd64c8b523eed, regionState=CLOSED 2023-07-12 16:15:38,350 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178538350"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178538350"}]},"ts":"1689178538350"} 2023-07-12 16:15:38,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 16:15:38,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 33d1b7b33c7f685fd26f045914bbb943 2023-07-12 16:15:38,360 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=33d1b7b33c7f685fd26f045914bbb943, regionState=CLOSED 2023-07-12 16:15:38,360 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178538360"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178538360"}]},"ts":"1689178538360"} 2023-07-12 16:15:38,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-12 16:15:38,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure b1a8b21c9def6c16dd4fd64c8b523eed, server=jenkins-hbase5.apache.org,36809,1689178459409 in 277 msec 2023-07-12 16:15:38,365 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-12 16:15:38,365 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 33d1b7b33c7f685fd26f045914bbb943, server=jenkins-hbase5.apache.org,45885,1689178459339 in 281 msec 2023-07-12 16:15:38,365 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1a8b21c9def6c16dd4fd64c8b523eed, UNASSIGN in 303 msec 2023-07-12 16:15:38,371 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-12 16:15:38,371 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=33d1b7b33c7f685fd26f045914bbb943, UNASSIGN in 305 msec 2023-07-12 16:15:38,372 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178538372"}]},"ts":"1689178538372"} 2023-07-12 16:15:38,374 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-12 16:15:38,377 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-12 16:15:38,381 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 336 msec 2023-07-12 16:15:38,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 16:15:38,658 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-12 16:15:38,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testConsecutiveExports 2023-07-12 16:15:38,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:38,665 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:38,666 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:38,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-12 16:15:38,670 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38727] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-12 16:15:38,677 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:38,677 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:38,677 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:38,677 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:38,678 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 16:15:38,678 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 16:15:38,678 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 16:15:38,678 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 16:15:38,683 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943 2023-07-12 16:15:38,684 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed 2023-07-12 16:15:38,684 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:38,684 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:38,685 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:38,685 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:38,685 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:38,685 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:38,685 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:38,685 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:38,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 16:15:38,687 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/cf, FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/recovered.edits] 2023-07-12 16:15:38,687 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/cf, FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/recovered.edits] 2023-07-12 16:15:38,693 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/cf/eef548040eb74bdab94bd3b717ee0da3 to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/cf/eef548040eb74bdab94bd3b717ee0da3 2023-07-12 16:15:38,693 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/cf/6bc412d9677b474e839a3e6d6a53fb02 to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/cf/6bc412d9677b474e839a3e6d6a53fb02 2023-07-12 16:15:38,697 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/recovered.edits/9.seqid to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943/recovered.edits/9.seqid 2023-07-12 16:15:38,698 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/33d1b7b33c7f685fd26f045914bbb943 2023-07-12 16:15:38,698 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/recovered.edits/9.seqid to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed/recovered.edits/9.seqid 2023-07-12 16:15:38,699 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testConsecutiveExports/b1a8b21c9def6c16dd4fd64c8b523eed 2023-07-12 16:15:38,699 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 16:15:38,702 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:38,705 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-12 16:15:38,707 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-12 16:15:38,708 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:38,708 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-12 16:15:38,708 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178538708"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:38,708 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178538708"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:38,710 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 16:15:38,710 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 33d1b7b33c7f685fd26f045914bbb943, NAME => 'testtb-testConsecutiveExports,,1689178504891.33d1b7b33c7f685fd26f045914bbb943.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b1a8b21c9def6c16dd4fd64c8b523eed, NAME => 'testtb-testConsecutiveExports,1,1689178504891.b1a8b21c9def6c16dd4fd64c8b523eed.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 16:15:38,710 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-12 16:15:38,710 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689178538710"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:38,712 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-12 16:15:38,715 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:38,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 56 msec 2023-07-12 16:15:38,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 16:15:38,787 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-12 16:15:38,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-12 16:15:38,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:38,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-12 16:15:38,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-12 16:15:38,829 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=747 (was 767), OpenFileDescriptor=903 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=418 (was 374) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 171), AvailableMemoryMB=4331 (was 3714) - AvailableMemoryMB LEAK? - 2023-07-12 16:15:38,829 WARN [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-12 16:15:38,855 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=418, ProcessCount=170, AvailableMemoryMB=4330 2023-07-12 16:15:38,855 WARN [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-12 16:15:38,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 16:15:38,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:38,861 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:15:38,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-12 16:15:38,862 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:15:38,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 16:15:38,865 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66 2023-07-12 16:15:38,865 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39 2023-07-12 16:15:38,866 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39 empty. 2023-07-12 16:15:38,866 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66 empty. 2023-07-12 16:15:38,866 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66 2023-07-12 16:15:38,867 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39 2023-07-12 16:15:38,867 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 16:15:38,891 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-12 16:15:38,892 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 54cecc48a60e599a500331808534ec66, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:15:38,892 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => f2fde191367a7517bb75fbabb2df5a39, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:15:38,933 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:38,934 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing f2fde191367a7517bb75fbabb2df5a39, disabling compactions & flushes 2023-07-12 16:15:38,934 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. 2023-07-12 16:15:38,934 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. 2023-07-12 16:15:38,934 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. after waiting 0 ms 2023-07-12 16:15:38,934 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. 2023-07-12 16:15:38,934 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. 2023-07-12 16:15:38,943 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for f2fde191367a7517bb75fbabb2df5a39: 2023-07-12 16:15:38,946 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:38,946 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 54cecc48a60e599a500331808534ec66, disabling compactions & flushes 2023-07-12 16:15:38,946 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:15:38,946 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:15:38,946 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. after waiting 0 ms 2023-07-12 16:15:38,946 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:15:38,946 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:15:38,946 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 54cecc48a60e599a500331808534ec66: 2023-07-12 16:15:38,953 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:15:38,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178538954"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178538954"}]},"ts":"1689178538954"} 2023-07-12 16:15:38,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178538954"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178538954"}]},"ts":"1689178538954"} 2023-07-12 16:15:38,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 16:15:38,970 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 16:15:38,972 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:15:38,972 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178538972"}]},"ts":"1689178538972"} 2023-07-12 16:15:38,974 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-12 16:15:38,979 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:15:38,981 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:15:38,981 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:15:38,981 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:15:38,981 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:15:38,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=54cecc48a60e599a500331808534ec66, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f2fde191367a7517bb75fbabb2df5a39, ASSIGN}] 2023-07-12 16:15:38,985 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=54cecc48a60e599a500331808534ec66, ASSIGN 2023-07-12 16:15:38,985 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f2fde191367a7517bb75fbabb2df5a39, ASSIGN 2023-07-12 16:15:38,987 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=54cecc48a60e599a500331808534ec66, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,38727,1689178459459; forceNewPlan=false, retain=false 2023-07-12 16:15:38,988 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f2fde191367a7517bb75fbabb2df5a39, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,36809,1689178459409; forceNewPlan=false, retain=false 2023-07-12 16:15:39,138 INFO [jenkins-hbase5:41835] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 16:15:39,141 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=f2fde191367a7517bb75fbabb2df5a39, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,141 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=54cecc48a60e599a500331808534ec66, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,141 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178539141"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178539141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178539141"}]},"ts":"1689178539141"} 2023-07-12 16:15:39,141 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178539141"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178539141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178539141"}]},"ts":"1689178539141"} 2023-07-12 16:15:39,144 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure f2fde191367a7517bb75fbabb2df5a39, server=jenkins-hbase5.apache.org,36809,1689178459409}] 2023-07-12 16:15:39,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 54cecc48a60e599a500331808534ec66, server=jenkins-hbase5.apache.org,38727,1689178459459}] 2023-07-12 16:15:39,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 16:15:39,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. 2023-07-12 16:15:39,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f2fde191367a7517bb75fbabb2df5a39, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 16:15:39,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. service=AccessControlService 2023-07-12 16:15:39,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:15:39,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f2fde191367a7517bb75fbabb2df5a39 2023-07-12 16:15:39,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:39,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for f2fde191367a7517bb75fbabb2df5a39 2023-07-12 16:15:39,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for f2fde191367a7517bb75fbabb2df5a39 2023-07-12 16:15:39,320 INFO [StoreOpener-f2fde191367a7517bb75fbabb2df5a39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f2fde191367a7517bb75fbabb2df5a39 2023-07-12 16:15:39,323 DEBUG [StoreOpener-f2fde191367a7517bb75fbabb2df5a39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/cf 2023-07-12 16:15:39,323 DEBUG [StoreOpener-f2fde191367a7517bb75fbabb2df5a39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/cf 2023-07-12 16:15:39,325 INFO [StoreOpener-f2fde191367a7517bb75fbabb2df5a39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2fde191367a7517bb75fbabb2df5a39 columnFamilyName cf 2023-07-12 16:15:39,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:15:39,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 54cecc48a60e599a500331808534ec66, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 16:15:39,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. service=AccessControlService 2023-07-12 16:15:39,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:15:39,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 54cecc48a60e599a500331808534ec66 2023-07-12 16:15:39,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:39,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 54cecc48a60e599a500331808534ec66 2023-07-12 16:15:39,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 54cecc48a60e599a500331808534ec66 2023-07-12 16:15:39,336 INFO [StoreOpener-f2fde191367a7517bb75fbabb2df5a39-1] regionserver.HStore(310): Store=f2fde191367a7517bb75fbabb2df5a39/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:15:39,341 INFO [StoreOpener-54cecc48a60e599a500331808534ec66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 54cecc48a60e599a500331808534ec66 2023-07-12 16:15:39,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39 2023-07-12 16:15:39,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39 2023-07-12 16:15:39,343 DEBUG [StoreOpener-54cecc48a60e599a500331808534ec66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/cf 2023-07-12 16:15:39,344 DEBUG [StoreOpener-54cecc48a60e599a500331808534ec66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/cf 2023-07-12 16:15:39,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for f2fde191367a7517bb75fbabb2df5a39 2023-07-12 16:15:39,348 INFO [StoreOpener-54cecc48a60e599a500331808534ec66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54cecc48a60e599a500331808534ec66 columnFamilyName cf 2023-07-12 16:15:39,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:15:39,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened f2fde191367a7517bb75fbabb2df5a39; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63502964, jitterRate=-0.053732097148895264}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:15:39,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for f2fde191367a7517bb75fbabb2df5a39: 2023-07-12 16:15:39,353 INFO [StoreOpener-54cecc48a60e599a500331808534ec66-1] regionserver.HStore(310): Store=54cecc48a60e599a500331808534ec66/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:15:39,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66 2023-07-12 16:15:39,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39., pid=60, masterSystemTime=1689178539297 2023-07-12 16:15:39,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66 2023-07-12 16:15:39,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. 2023-07-12 16:15:39,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. 2023-07-12 16:15:39,357 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=f2fde191367a7517bb75fbabb2df5a39, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,358 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178539357"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178539357"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178539357"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178539357"}]},"ts":"1689178539357"} 2023-07-12 16:15:39,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 54cecc48a60e599a500331808534ec66 2023-07-12 16:15:39,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-12 16:15:39,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure f2fde191367a7517bb75fbabb2df5a39, server=jenkins-hbase5.apache.org,36809,1689178459409 in 217 msec 2023-07-12 16:15:39,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f2fde191367a7517bb75fbabb2df5a39, ASSIGN in 386 msec 2023-07-12 16:15:39,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:15:39,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 54cecc48a60e599a500331808534ec66; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60194024, jitterRate=-0.10303914546966553}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:15:39,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 54cecc48a60e599a500331808534ec66: 2023-07-12 16:15:39,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66., pid=61, masterSystemTime=1689178539299 2023-07-12 16:15:39,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:15:39,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:15:39,372 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=54cecc48a60e599a500331808534ec66, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,372 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178539372"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178539372"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178539372"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178539372"}]},"ts":"1689178539372"} 2023-07-12 16:15:39,376 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-12 16:15:39,376 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 54cecc48a60e599a500331808534ec66, server=jenkins-hbase5.apache.org,38727,1689178459459 in 227 msec 2023-07-12 16:15:39,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-12 16:15:39,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=54cecc48a60e599a500331808534ec66, ASSIGN in 395 msec 2023-07-12 16:15:39,379 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:15:39,379 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178539379"}]},"ts":"1689178539379"} 2023-07-12 16:15:39,380 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-12 16:15:39,382 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:15:39,383 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-12 16:15:39,384 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38727] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 16:15:39,386 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:39,386 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:39,386 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:39,388 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:39,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:39,389 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:39,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:39,391 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:39,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 532 msec 2023-07-12 16:15:39,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 16:15:39,473 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-12 16:15:39,473 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-12 16:15:39,473 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:15:39,477 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-12 16:15:39,477 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:15:39,477 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-12 16:15:39,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 16:15:39,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178539484 (current time:1689178539484). 2023-07-12 16:15:39,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:15:39,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x3936b4c3 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:39,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@740a7726, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:39,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:39,503 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:39838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:39,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3936b4c3 to 127.0.0.1:62419 2023-07-12 16:15:39,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:39,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x06b95c2e to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:39,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a257096, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:39,512 DEBUG [hconnection-0x2d3195b3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:39,513 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:39844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:39,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06b95c2e to 127.0.0.1:62419 2023-07-12 16:15:39,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:39,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 16:15:39,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:15:39,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 16:15:39,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 16:15:39,524 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 16:15:39,525 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689179139525 2023-07-12 16:15:39,525 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 16:15:39,526 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:15:39,527 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:15:39,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 16:15:39,530 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 16:15:39,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-12 16:15:39,533 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 16:15:39,534 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689179139534 2023-07-12 16:15:39,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,552 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 16:15:39,552 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:39,553 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 16:15:39,553 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 16:15:39,627 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:39,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 16:15:39,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:15:39,628 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:15:39,635 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,635 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,637 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:39,637 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:39,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:39,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:39,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:39,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:39,637 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:39,637 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:39,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:39,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,638 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,638 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,638 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,639 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,639 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:15:39,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 16:15:39,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,639 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 16:15:39,639 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,639 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 16:15:39,640 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:39,641 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 16:15:39,641 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 16:15:39,641 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 16:15:39,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 16:15:39,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 16:15:39,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,642 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 16:15:39,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,642 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,642 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 16:15:39,642 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:39,642 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 16:15:39,643 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,643 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,643 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 16:15:39,644 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 16:15:39,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:39,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:39,644 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 16:15:39,644 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,644 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:39,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:39,645 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,646 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 16:15:39,646 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:39,647 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 16:15:39,647 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 16:15:39,647 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 16:15:39,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:39,647 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,648 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,648 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:39,649 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,649 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,649 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,649 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:39,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:39,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:39,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 16:15:39,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40610de4[Count = 1] remaining members to acquire global barrier 2023-07-12 16:15:39,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:39,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:39,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:39,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:39,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:39,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:39,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 16:15:39,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40610de4[Count = 0] remaining members to acquire global barrier 2023-07-12 16:15:39,653 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 16:15:39,653 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,655 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,655 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,655 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,655 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 16:15:39,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,655 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,655 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 16:15:39,655 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 16:15:39,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,656 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:39,656 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:39,656 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,45885,1689178459339' in zk 2023-07-12 16:15:39,656 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. 2023-07-12 16:15:39,656 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 16:15:39,656 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. started... 2023-07-12 16:15:39,656 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:39,656 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:39,656 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:15:39,658 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,659 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:15:39,657 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f2fde191367a7517bb75fbabb2df5a39: 2023-07-12 16:15:39,658 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. started... 2023-07-12 16:15:39,659 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,660 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 54cecc48a60e599a500331808534ec66: 2023-07-12 16:15:39,660 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:39,660 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:15:39,660 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,660 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:39,660 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:15:39,664 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 16:15:39,664 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:39,664 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 16:15:39,684 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. completed. 2023-07-12 16:15:39,684 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. 2023-07-12 16:15:39,684 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:39,684 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:39,684 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,684 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 16:15:39,684 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,36809,1689178459409' in zk 2023-07-12 16:15:39,686 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. completed. 2023-07-12 16:15:39,686 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:15:39,686 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:39,686 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:39,686 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,686 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 16:15:39,686 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,38727,1689178459459' in zk 2023-07-12 16:15:39,687 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 16:15:39,687 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,687 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:39,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:39,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:39,687 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 16:15:39,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:39,690 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,690 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 16:15:39,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:39,690 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:39,690 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 16:15:39,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:39,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase5.apache.org,36809,1689178459409': 2023-07-12 16:15:39,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 16:15:39,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:39,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:39,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:39,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:39,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:39,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:39,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:39,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase5.apache.org,38727,1689178459459': 2023-07-12 16:15:39,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 16:15:39,699 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 16:15:39,699 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:15:39,699 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:15:39,699 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,699 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:15:39,702 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,702 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:39,702 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,702 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,702 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,702 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:39,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:39,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:39,702 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:39,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,703 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:39,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:39,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:39,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:39,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:39,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:39,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:39,703 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,707 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:39,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:39,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:39,713 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,713 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,714 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:39,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:39,718 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:39,718 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,718 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:39,718 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:39,718 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:39,718 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:39,718 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,718 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:39,718 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:39,718 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,720 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:39,718 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:39,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:39,720 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:39,720 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:39,720 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,720 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:39,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:39,720 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:39,721 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:39,721 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,781 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 16:15:39,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,782 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689178539525Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689178539720 (+195 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689178539720Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689178539725 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689178539746 (+21 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689178539781 (+35 ms) 2023-07-12 16:15:39,785 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 16:15:39,789 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 259 msec 2023-07-12 16:15:39,828 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:39,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 16:15:39,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:15:39,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:15:39,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36809] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:15:39,848 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,848 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:15:39,850 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:15:39,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 16:15:39,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178539867 (current time:1689178539867). 2023-07-12 16:15:39,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:15:39,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x789947f8 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:39,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a1684be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:39,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:39,889 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:39848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:39,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x789947f8 to 127.0.0.1:62419 2023-07-12 16:15:39,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:39,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x68c6833e to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:39,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ad2af59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:39,913 DEBUG [hconnection-0x249ff3c9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:39,917 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:39860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:39,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68c6833e to 127.0.0.1:62419 2023-07-12 16:15:39,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:39,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 16:15:39,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:15:39,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 16:15:39,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 16:15:39,935 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 16:15:39,936 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689179139936 2023-07-12 16:15:39,936 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 16:15:39,939 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:15:39,939 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:15:39,940 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 16:15:39,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 16:15:39,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-12 16:15:39,943 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 16:15:39,944 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689179139944 2023-07-12 16:15:39,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,960 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 16:15:39,960 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:39,962 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 16:15:39,962 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 16:15:39,963 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,963 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,964 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:39,964 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:39,964 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:39,964 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:39,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:39,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:39,965 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,965 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,966 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,966 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:15:39,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 16:15:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,966 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 16:15:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 16:15:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 16:15:39,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,967 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 16:15:39,967 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 16:15:39,967 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,967 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,967 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 16:15:39,967 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 16:15:39,967 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,967 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:39,967 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 16:15:39,967 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:39,967 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:39,970 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 16:15:39,971 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 16:15:39,969 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 16:15:39,972 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 16:15:39,971 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 16:15:39,971 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 16:15:39,972 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 16:15:39,972 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 16:15:39,972 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 16:15:39,973 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,973 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,973 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:39,975 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,975 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:39,975 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,976 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:39,975 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,976 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,976 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:39,975 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:39,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:39,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 16:15:39,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@531d5cee[Count = 1] remaining members to acquire global barrier 2023-07-12 16:15:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:39,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:39,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 16:15:39,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@531d5cee[Count = 0] remaining members to acquire global barrier 2023-07-12 16:15:39,981 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 16:15:39,981 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,983 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,983 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,983 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,984 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 16:15:39,984 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 16:15:39,984 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 16:15:39,984 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,45885,1689178459339' in zk 2023-07-12 16:15:39,984 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:39,984 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:39,985 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:39,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:39,985 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 16:15:39,984 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:15:39,986 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:39,986 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. started... 2023-07-12 16:15:39,986 INFO [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 54cecc48a60e599a500331808534ec66 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-12 16:15:39,985 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:39,987 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:39,985 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. 2023-07-12 16:15:39,986 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:15:39,987 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. started... 2023-07-12 16:15:39,987 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 16:15:39,987 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:39,987 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 16:15:39,987 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f2fde191367a7517bb75fbabb2df5a39 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-12 16:15:40,037 INFO [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/.tmp/cf/7e03aff5929742069f12df05ea5dff6a 2023-07-12 16:15:40,039 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:40,041 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/.tmp/cf/c5236608fb5349b396c3a8278b7efb3d 2023-07-12 16:15:40,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 16:15:40,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:15:40,041 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:15:40,047 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/.tmp/cf/7e03aff5929742069f12df05ea5dff6a as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/cf/7e03aff5929742069f12df05ea5dff6a 2023-07-12 16:15:40,051 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/.tmp/cf/c5236608fb5349b396c3a8278b7efb3d as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/cf/c5236608fb5349b396c3a8278b7efb3d 2023-07-12 16:15:40,060 INFO [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/cf/7e03aff5929742069f12df05ea5dff6a, entries=5, sequenceid=6, filesize=5.2 K 2023-07-12 16:15:40,061 INFO [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 54cecc48a60e599a500331808534ec66 in 75ms, sequenceid=6, compaction requested=false 2023-07-12 16:15:40,061 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-12 16:15:40,062 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 54cecc48a60e599a500331808534ec66: 2023-07-12 16:15:40,062 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,062 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:40,062 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/cf/7e03aff5929742069f12df05ea5dff6a] hfiles 2023-07-12 16:15:40,062 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/cf/7e03aff5929742069f12df05ea5dff6a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,068 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/cf/c5236608fb5349b396c3a8278b7efb3d, entries=45, sequenceid=6, filesize=7.9 K 2023-07-12 16:15:40,070 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for f2fde191367a7517bb75fbabb2df5a39 in 83ms, sequenceid=6, compaction requested=false 2023-07-12 16:15:40,084 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f2fde191367a7517bb75fbabb2df5a39: 2023-07-12 16:15:40,084 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,085 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:40,085 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/cf/c5236608fb5349b396c3a8278b7efb3d] hfiles 2023-07-12 16:15:40,085 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/cf/c5236608fb5349b396c3a8278b7efb3d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,125 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. completed. 2023-07-12 16:15:40,125 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. 2023-07-12 16:15:40,125 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:40,125 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:40,125 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:40,125 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 16:15:40,125 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,36809,1689178459409' in zk 2023-07-12 16:15:40,127 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 16:15:40,127 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:40,127 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:40,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:40,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:40,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:40,128 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 16:15:40,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:40,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:40,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:40,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:40,135 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. completed. 2023-07-12 16:15:40,135 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:15:40,135 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:40,135 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:40,135 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:40,135 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 16:15:40,135 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,38727,1689178459459' in zk 2023-07-12 16:15:40,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:40,138 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 16:15:40,138 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:40,138 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 16:15:40,140 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:40,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:40,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:40,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:40,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:40,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase5.apache.org,36809,1689178459409': 2023-07-12 16:15:40,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 16:15:40,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:40,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:40,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:40,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:40,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:40,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:40,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:40,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:40,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:40,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:40,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:40,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:40,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase5.apache.org,38727,1689178459459': 2023-07-12 16:15:40,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 16:15:40,147 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 16:15:40,147 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:15:40,147 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:15:40,147 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,147 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:15:40,152 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,152 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:40,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,152 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:40,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:40,154 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,154 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:40,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,154 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,154 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:40,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:40,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:40,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:40,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:40,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:40,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:40,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:40,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,156 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:40,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,157 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:40,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:40,163 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:40,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:40,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:40,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:40,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:40,166 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:40,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,166 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:40,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:40,167 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:40,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:40,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:40,170 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:40,171 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,171 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:40,171 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:40,171 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:40,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:40,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:40,171 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:40,171 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:40,171 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:40,171 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:40,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:40,173 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:40,173 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:40,171 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:40,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:40,173 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:40,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:40,173 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:40,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:40,173 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,174 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:40,174 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:40,174 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,174 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:40,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:40,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:40,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:40,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,242 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:40,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 16:15:40,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:15:40,243 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 16:15:40,295 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 16:15:40,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,296 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689178539936Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689178540173 (+237 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689178540173Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689178540178 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689178540211 (+33 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689178540295 (+84 ms) 2023-07-12 16:15:40,299 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 16:15:40,303 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 361 msec 2023-07-12 16:15:40,543 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:40,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 16:15:40,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:15:40,589 DEBUG [Listener at jenkins-hbase5.apache.org/43841] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 16:15:40,604 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:60976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 16:15:40,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36809] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 16:15:40,609 DEBUG [Listener at jenkins-hbase5.apache.org/43841] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 16:15:40,615 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:39876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 16:15:40,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 16:15:40,617 DEBUG [Listener at jenkins-hbase5.apache.org/43841] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 16:15:40,638 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:45648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 16:15:40,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 16:15:40,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 16:15:40,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:40,654 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:15:40,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-12 16:15:40,655 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:15:40,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 16:15:40,659 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966 2023-07-12 16:15:40,663 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966 empty. 2023-07-12 16:15:40,667 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966 2023-07-12 16:15:40,667 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145 2023-07-12 16:15:40,668 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145 empty. 2023-07-12 16:15:40,669 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145 2023-07-12 16:15:40,669 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 16:15:40,708 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-12 16:15:40,712 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 120c449bd918eae67eca44c760d1d966, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:15:40,717 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3d0c2f0a21401909c8b960ebb02d0145, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:15:40,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 16:15:40,772 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:40,772 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 120c449bd918eae67eca44c760d1d966, disabling compactions & flushes 2023-07-12 16:15:40,772 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966. 2023-07-12 16:15:40,772 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966. 2023-07-12 16:15:40,772 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966. after waiting 0 ms 2023-07-12 16:15:40,772 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966. 2023-07-12 16:15:40,772 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966. 2023-07-12 16:15:40,772 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 120c449bd918eae67eca44c760d1d966: 2023-07-12 16:15:40,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:40,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 3d0c2f0a21401909c8b960ebb02d0145, disabling compactions & flushes 2023-07-12 16:15:40,787 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145. 2023-07-12 16:15:40,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145. 2023-07-12 16:15:40,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145. after waiting 0 ms 2023-07-12 16:15:40,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145. 2023-07-12 16:15:40,787 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145. 2023-07-12 16:15:40,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 3d0c2f0a21401909c8b960ebb02d0145: 2023-07-12 16:15:40,791 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:15:40,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178540792"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178540792"}]},"ts":"1689178540792"} 2023-07-12 16:15:40,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178540792"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178540792"}]},"ts":"1689178540792"} 2023-07-12 16:15:40,795 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 16:15:40,796 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:15:40,797 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178540796"}]},"ts":"1689178540796"} 2023-07-12 16:15:40,798 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-12 16:15:40,803 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:15:40,804 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:15:40,804 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:15:40,804 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:15:40,804 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:15:40,805 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=120c449bd918eae67eca44c760d1d966, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3d0c2f0a21401909c8b960ebb02d0145, ASSIGN}] 2023-07-12 16:15:40,808 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3d0c2f0a21401909c8b960ebb02d0145, ASSIGN 2023-07-12 16:15:40,808 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=120c449bd918eae67eca44c760d1d966, ASSIGN 2023-07-12 16:15:40,809 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3d0c2f0a21401909c8b960ebb02d0145, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,36809,1689178459409; forceNewPlan=false, retain=false 2023-07-12 16:15:40,809 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=120c449bd918eae67eca44c760d1d966, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,45885,1689178459339; forceNewPlan=false, retain=false 2023-07-12 16:15:40,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 16:15:40,960 INFO [jenkins-hbase5:41835] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 16:15:40,962 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=120c449bd918eae67eca44c760d1d966, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:40,962 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=3d0c2f0a21401909c8b960ebb02d0145, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:40,963 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178540962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178540962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178540962"}]},"ts":"1689178540962"} 2023-07-12 16:15:40,963 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178540962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178540962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178540962"}]},"ts":"1689178540962"} 2023-07-12 16:15:40,965 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 120c449bd918eae67eca44c760d1d966, server=jenkins-hbase5.apache.org,45885,1689178459339}] 2023-07-12 16:15:40,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 3d0c2f0a21401909c8b960ebb02d0145, server=jenkins-hbase5.apache.org,36809,1689178459409}] 2023-07-12 16:15:41,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145. 2023-07-12 16:15:41,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3d0c2f0a21401909c8b960ebb02d0145, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 16:15:41,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966. 2023-07-12 16:15:41,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 120c449bd918eae67eca44c760d1d966, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966.', STARTKEY => '', ENDKEY => '2'} 2023-07-12 16:15:41,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145. service=AccessControlService 2023-07-12 16:15:41,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966. service=AccessControlService 2023-07-12 16:15:41,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:15:41,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:15:41,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 3d0c2f0a21401909c8b960ebb02d0145 2023-07-12 16:15:41,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 120c449bd918eae67eca44c760d1d966 2023-07-12 16:15:41,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:41,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:41,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 3d0c2f0a21401909c8b960ebb02d0145 2023-07-12 16:15:41,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 120c449bd918eae67eca44c760d1d966 2023-07-12 16:15:41,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 120c449bd918eae67eca44c760d1d966 2023-07-12 16:15:41,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 3d0c2f0a21401909c8b960ebb02d0145 2023-07-12 16:15:41,134 INFO [StoreOpener-120c449bd918eae67eca44c760d1d966-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 120c449bd918eae67eca44c760d1d966 2023-07-12 16:15:41,135 INFO [StoreOpener-3d0c2f0a21401909c8b960ebb02d0145-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3d0c2f0a21401909c8b960ebb02d0145 2023-07-12 16:15:41,137 DEBUG [StoreOpener-3d0c2f0a21401909c8b960ebb02d0145-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/cf 2023-07-12 16:15:41,138 DEBUG [StoreOpener-3d0c2f0a21401909c8b960ebb02d0145-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/cf 2023-07-12 16:15:41,138 DEBUG [StoreOpener-120c449bd918eae67eca44c760d1d966-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/cf 2023-07-12 16:15:41,138 DEBUG [StoreOpener-120c449bd918eae67eca44c760d1d966-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/cf 2023-07-12 16:15:41,138 INFO [StoreOpener-3d0c2f0a21401909c8b960ebb02d0145-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d0c2f0a21401909c8b960ebb02d0145 columnFamilyName cf 2023-07-12 16:15:41,139 INFO [StoreOpener-120c449bd918eae67eca44c760d1d966-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 120c449bd918eae67eca44c760d1d966 columnFamilyName cf 2023-07-12 16:15:41,139 INFO [StoreOpener-3d0c2f0a21401909c8b960ebb02d0145-1] regionserver.HStore(310): Store=3d0c2f0a21401909c8b960ebb02d0145/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:15:41,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145 2023-07-12 16:15:41,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145 2023-07-12 16:15:41,144 INFO [StoreOpener-120c449bd918eae67eca44c760d1d966-1] regionserver.HStore(310): Store=120c449bd918eae67eca44c760d1d966/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:15:41,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966 2023-07-12 16:15:41,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966 2023-07-12 16:15:41,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 3d0c2f0a21401909c8b960ebb02d0145 2023-07-12 16:15:41,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:15:41,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 120c449bd918eae67eca44c760d1d966 2023-07-12 16:15:41,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 3d0c2f0a21401909c8b960ebb02d0145; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65379428, jitterRate=-0.025770604610443115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:15:41,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 3d0c2f0a21401909c8b960ebb02d0145: 2023-07-12 16:15:41,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145., pid=70, masterSystemTime=1689178541121 2023-07-12 16:15:41,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145. 2023-07-12 16:15:41,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145. 2023-07-12 16:15:41,166 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=3d0c2f0a21401909c8b960ebb02d0145, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:41,167 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178541166"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178541166"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178541166"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178541166"}]},"ts":"1689178541166"} 2023-07-12 16:15:41,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:15:41,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 120c449bd918eae67eca44c760d1d966; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67406961, jitterRate=0.004441991448402405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:15:41,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 120c449bd918eae67eca44c760d1d966: 2023-07-12 16:15:41,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966., pid=69, masterSystemTime=1689178541121 2023-07-12 16:15:41,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966. 2023-07-12 16:15:41,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966. 2023-07-12 16:15:41,179 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=120c449bd918eae67eca44c760d1d966, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:41,180 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178541179"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178541179"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178541179"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178541179"}]},"ts":"1689178541179"} 2023-07-12 16:15:41,185 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-12 16:15:41,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 3d0c2f0a21401909c8b960ebb02d0145, server=jenkins-hbase5.apache.org,36809,1689178459409 in 207 msec 2023-07-12 16:15:41,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-12 16:15:41,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 120c449bd918eae67eca44c760d1d966, server=jenkins-hbase5.apache.org,45885,1689178459339 in 217 msec 2023-07-12 16:15:41,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3d0c2f0a21401909c8b960ebb02d0145, ASSIGN in 380 msec 2023-07-12 16:15:41,199 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-12 16:15:41,200 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=120c449bd918eae67eca44c760d1d966, ASSIGN in 381 msec 2023-07-12 16:15:41,203 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:15:41,204 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178541203"}]},"ts":"1689178541203"} 2023-07-12 16:15:41,206 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-12 16:15:41,208 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:15:41,209 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-12 16:15:41,211 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38727] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 16:15:41,213 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:41,213 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:41,213 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:41,213 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:41,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:41,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:41,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:41,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:41,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:41,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:41,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:41,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:41,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 564 msec 2023-07-12 16:15:41,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 16:15:41,261 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-12 16:15:41,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$2(1952): Client=jenkins//172.31.10.131 merge regions 120c449bd918eae67eca44c760d1d966, 3d0c2f0a21401909c8b960ebb02d0145 2023-07-12 16:15:41,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[120c449bd918eae67eca44c760d1d966, 3d0c2f0a21401909c8b960ebb02d0145], force=true 2023-07-12 16:15:41,343 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[120c449bd918eae67eca44c760d1d966, 3d0c2f0a21401909c8b960ebb02d0145], force=true 2023-07-12 16:15:41,344 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[120c449bd918eae67eca44c760d1d966, 3d0c2f0a21401909c8b960ebb02d0145], force=true 2023-07-12 16:15:41,344 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[120c449bd918eae67eca44c760d1d966, 3d0c2f0a21401909c8b960ebb02d0145], force=true 2023-07-12 16:15:41,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 16:15:41,374 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=120c449bd918eae67eca44c760d1d966, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3d0c2f0a21401909c8b960ebb02d0145, UNASSIGN}] 2023-07-12 16:15:41,379 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=120c449bd918eae67eca44c760d1d966, UNASSIGN 2023-07-12 16:15:41,379 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3d0c2f0a21401909c8b960ebb02d0145, UNASSIGN 2023-07-12 16:15:41,380 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=120c449bd918eae67eca44c760d1d966, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:41,380 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=3d0c2f0a21401909c8b960ebb02d0145, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:41,381 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178541380"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178541380"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178541380"}]},"ts":"1689178541380"} 2023-07-12 16:15:41,381 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178541380"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178541380"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178541380"}]},"ts":"1689178541380"} 2023-07-12 16:15:41,382 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 120c449bd918eae67eca44c760d1d966, server=jenkins-hbase5.apache.org,45885,1689178459339}] 2023-07-12 16:15:41,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 3d0c2f0a21401909c8b960ebb02d0145, server=jenkins-hbase5.apache.org,36809,1689178459409}] 2023-07-12 16:15:41,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 16:15:41,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 120c449bd918eae67eca44c760d1d966 2023-07-12 16:15:41,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 120c449bd918eae67eca44c760d1d966, disabling compactions & flushes 2023-07-12 16:15:41,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966. 2023-07-12 16:15:41,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966. 2023-07-12 16:15:41,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966. after waiting 0 ms 2023-07-12 16:15:41,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966. 2023-07-12 16:15:41,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 120c449bd918eae67eca44c760d1d966 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 16:15:41,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 3d0c2f0a21401909c8b960ebb02d0145 2023-07-12 16:15:41,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 3d0c2f0a21401909c8b960ebb02d0145, disabling compactions & flushes 2023-07-12 16:15:41,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145. 2023-07-12 16:15:41,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145. 2023-07-12 16:15:41,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145. after waiting 0 ms 2023-07-12 16:15:41,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145. 2023-07-12 16:15:41,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 3d0c2f0a21401909c8b960ebb02d0145 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 16:15:41,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/.tmp/cf/4b81075f9fb64183a879d2911850f9cd 2023-07-12 16:15:41,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/.tmp/cf/288b76fb3b594f918873945a7f91f1f6 2023-07-12 16:15:41,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/.tmp/cf/288b76fb3b594f918873945a7f91f1f6 as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/cf/288b76fb3b594f918873945a7f91f1f6 2023-07-12 16:15:41,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/.tmp/cf/4b81075f9fb64183a879d2911850f9cd as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/cf/4b81075f9fb64183a879d2911850f9cd 2023-07-12 16:15:41,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/cf/4b81075f9fb64183a879d2911850f9cd, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 16:15:41,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/cf/288b76fb3b594f918873945a7f91f1f6, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 16:15:41,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 3d0c2f0a21401909c8b960ebb02d0145 in 44ms, sequenceid=5, compaction requested=false 2023-07-12 16:15:41,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 120c449bd918eae67eca44c760d1d966 in 48ms, sequenceid=5, compaction requested=false 2023-07-12 16:15:41,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 16:15:41,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 16:15:41,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 16:15:41,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 16:15:41,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:15:41,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:15:41,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966. 2023-07-12 16:15:41,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145. 2023-07-12 16:15:41,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 3d0c2f0a21401909c8b960ebb02d0145: 2023-07-12 16:15:41,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 120c449bd918eae67eca44c760d1d966: 2023-07-12 16:15:41,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 3d0c2f0a21401909c8b960ebb02d0145 2023-07-12 16:15:41,598 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=3d0c2f0a21401909c8b960ebb02d0145, regionState=CLOSED 2023-07-12 16:15:41,598 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178541598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178541598"}]},"ts":"1689178541598"} 2023-07-12 16:15:41,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 120c449bd918eae67eca44c760d1d966 2023-07-12 16:15:41,599 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=120c449bd918eae67eca44c760d1d966, regionState=CLOSED 2023-07-12 16:15:41,599 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178541599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178541599"}]},"ts":"1689178541599"} 2023-07-12 16:15:41,602 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-12 16:15:41,602 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 3d0c2f0a21401909c8b960ebb02d0145, server=jenkins-hbase5.apache.org,36809,1689178459409 in 215 msec 2023-07-12 16:15:41,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-12 16:15:41,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 120c449bd918eae67eca44c760d1d966, server=jenkins-hbase5.apache.org,45885,1689178459339 in 219 msec 2023-07-12 16:15:41,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3d0c2f0a21401909c8b960ebb02d0145, UNASSIGN in 228 msec 2023-07-12 16:15:41,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-12 16:15:41,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=120c449bd918eae67eca44c760d1d966, UNASSIGN in 232 msec 2023-07-12 16:15:41,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 16:15:41,863 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-12 16:15:41,866 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540649.120c449bd918eae67eca44c760d1d966.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:41,866 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178540649.3d0c2f0a21401909c8b960ebb02d0145.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:41,866 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:41,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 16:15:42,003 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b9ca029f5ae48b219c7c2f4b1fd79f29, ASSIGN}] 2023-07-12 16:15:42,037 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b9ca029f5ae48b219c7c2f4b1fd79f29, ASSIGN 2023-07-12 16:15:42,039 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b9ca029f5ae48b219c7c2f4b1fd79f29, ASSIGN; state=MERGED, location=jenkins-hbase5.apache.org,45885,1689178459339; forceNewPlan=false, retain=false 2023-07-12 16:15:42,189 INFO [jenkins-hbase5:41835] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 16:15:42,191 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b9ca029f5ae48b219c7c2f4b1fd79f29, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:42,192 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689178542191"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178542191"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178542191"}]},"ts":"1689178542191"} 2023-07-12 16:15:42,194 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure b9ca029f5ae48b219c7c2f4b1fd79f29, server=jenkins-hbase5.apache.org,45885,1689178459339}] 2023-07-12 16:15:42,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29. 2023-07-12 16:15:42,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b9ca029f5ae48b219c7c2f4b1fd79f29, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29.', STARTKEY => '', ENDKEY => ''} 2023-07-12 16:15:42,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29. service=AccessControlService 2023-07-12 16:15:42,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:15:42,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b9ca029f5ae48b219c7c2f4b1fd79f29 2023-07-12 16:15:42,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:42,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for b9ca029f5ae48b219c7c2f4b1fd79f29 2023-07-12 16:15:42,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for b9ca029f5ae48b219c7c2f4b1fd79f29 2023-07-12 16:15:42,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/.regioninfo 2023-07-12 16:15:42,430 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0004_000001 (auth:SIMPLE) 2023-07-12 16:15:42,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 16:15:42,493 INFO [StoreOpener-b9ca029f5ae48b219c7c2f4b1fd79f29-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b9ca029f5ae48b219c7c2f4b1fd79f29 2023-07-12 16:15:42,496 DEBUG [StoreOpener-b9ca029f5ae48b219c7c2f4b1fd79f29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/cf 2023-07-12 16:15:42,496 DEBUG [StoreOpener-b9ca029f5ae48b219c7c2f4b1fd79f29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/cf 2023-07-12 16:15:42,496 INFO [StoreOpener-b9ca029f5ae48b219c7c2f4b1fd79f29-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9ca029f5ae48b219c7c2f4b1fd79f29 columnFamilyName cf 2023-07-12 16:15:42,534 DEBUG [StoreOpener-b9ca029f5ae48b219c7c2f4b1fd79f29-1] regionserver.HStore(539): loaded hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/cf/288b76fb3b594f918873945a7f91f1f6.120c449bd918eae67eca44c760d1d966->hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/cf/288b76fb3b594f918873945a7f91f1f6-top 2023-07-12 16:15:42,540 DEBUG [StoreOpener-b9ca029f5ae48b219c7c2f4b1fd79f29-1] regionserver.HStore(539): loaded hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/cf/4b81075f9fb64183a879d2911850f9cd.3d0c2f0a21401909c8b960ebb02d0145->hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/cf/4b81075f9fb64183a879d2911850f9cd-top 2023-07-12 16:15:42,541 INFO [StoreOpener-b9ca029f5ae48b219c7c2f4b1fd79f29-1] regionserver.HStore(310): Store=b9ca029f5ae48b219c7c2f4b1fd79f29/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:15:42,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29 2023-07-12 16:15:42,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29 2023-07-12 16:15:42,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for b9ca029f5ae48b219c7c2f4b1fd79f29 2023-07-12 16:15:42,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened b9ca029f5ae48b219c7c2f4b1fd79f29; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62046404, jitterRate=-0.075436532497406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:15:42,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for b9ca029f5ae48b219c7c2f4b1fd79f29: 2023-07-12 16:15:42,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29., pid=77, masterSystemTime=1689178542345 2023-07-12 16:15:42,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29.,because compaction is disabled. 2023-07-12 16:15:42,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29. 2023-07-12 16:15:42,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29. 2023-07-12 16:15:42,633 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b9ca029f5ae48b219c7c2f4b1fd79f29, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:42,634 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689178542633"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178542633"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178542633"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178542633"}]},"ts":"1689178542633"} 2023-07-12 16:15:42,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-12 16:15:42,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure b9ca029f5ae48b219c7c2f4b1fd79f29, server=jenkins-hbase5.apache.org,45885,1689178459339 in 444 msec 2023-07-12 16:15:42,748 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-12 16:15:42,748 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b9ca029f5ae48b219c7c2f4b1fd79f29, ASSIGN in 706 msec 2023-07-12 16:15:42,750 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[120c449bd918eae67eca44c760d1d966, 3d0c2f0a21401909c8b960ebb02d0145], force=true in 1.4350 sec 2023-07-12 16:15:43,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 16:15:43,454 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-12 16:15:43,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 16:15:43,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178543455 (current time:1689178543455). 2023-07-12 16:15:43,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:15:43,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x34749839 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:43,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32fd74cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:43,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:43,465 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:39878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:43,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34749839 to 127.0.0.1:62419 2023-07-12 16:15:43,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:43,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x1c07c8b8 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:43,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ca23e51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:43,472 DEBUG [hconnection-0x55a07806-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:43,473 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:39882, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:43,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c07c8b8 to 127.0.0.1:62419 2023-07-12 16:15:43,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:43,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 16:15:43,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:15:43,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 16:15:43,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 16:15:43,481 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 16:15:43,484 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689179143484 2023-07-12 16:15:43,484 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 16:15:43,487 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:15:43,487 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:15:43,488 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 16:15:43,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 16:15:43,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-07-12 16:15:43,490 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 16:15:43,491 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689179143491 2023-07-12 16:15:43,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,499 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 16:15:43,499 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:43,500 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-12 16:15:43,500 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-12 16:15:43,501 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,501 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,502 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:43,502 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:43,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:43,502 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,502 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:43,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:43,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:43,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:43,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:43,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:43,503 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,503 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:15:43,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 16:15:43,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,504 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 16:15:43,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 16:15:43,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 16:15:43,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,504 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 16:15:43,504 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,504 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 16:15:43,504 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 16:15:43,504 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:43,504 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,505 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 16:15:43,505 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 16:15:43,505 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:43,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,506 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 16:15:43,506 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 16:15:43,505 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 16:15:43,506 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 16:15:43,506 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 16:15:43,506 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:43,506 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 16:15:43,507 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 16:15:43,507 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 16:15:43,507 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 16:15:43,508 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,508 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:43,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:43,509 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:43,509 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,509 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:43,509 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,509 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,509 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:43,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:43,509 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,509 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:43,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:43,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:43,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:43,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-12 16:15:43,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b1662fd[Count = 0] remaining members to acquire global barrier 2023-07-12 16:15:43,511 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-12 16:15:43,511 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,513 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,513 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,513 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,513 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 16:15:43,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,513 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,513 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:15:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,513 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 16:15:43,513 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 16:15:43,513 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 16:15:43,513 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 16:15:43,513 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase5.apache.org,38727,1689178459459' in zk 2023-07-12 16:15:43,513 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase5.apache.org,36809,1689178459409' in zk 2023-07-12 16:15:43,514 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:43,514 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:43,514 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29. 2023-07-12 16:15:43,514 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29. started... 2023-07-12 16:15:43,515 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b9ca029f5ae48b219c7c2f4b1fd79f29: 2023-07-12 16:15:43,515 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,515 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:43,515 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/cf/288b76fb3b594f918873945a7f91f1f6.120c449bd918eae67eca44c760d1d966->hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/cf/288b76fb3b594f918873945a7f91f1f6-top, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/cf/4b81075f9fb64183a879d2911850f9cd.3d0c2f0a21401909c8b960ebb02d0145->hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/cf/4b81075f9fb64183a879d2911850f9cd-top] hfiles 2023-07-12 16:15:43,515 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/cf/288b76fb3b594f918873945a7f91f1f6.120c449bd918eae67eca44c760d1d966 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,516 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 16:15:43,516 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:43,516 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 16:15:43,516 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/cf/4b81075f9fb64183a879d2911850f9cd.3d0c2f0a21401909c8b960ebb02d0145 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,516 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 16:15:43,516 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:43,517 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 16:15:43,530 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29. completed. 2023-07-12 16:15:43,530 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29. 2023-07-12 16:15:43,530 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:43,530 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:43,530 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,530 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 16:15:43,530 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase5.apache.org,45885,1689178459339' in zk 2023-07-12 16:15:43,538 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 16:15:43,538 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,538 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:43,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:43,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:43,538 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 16:15:43,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:43,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:43,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:43,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase5.apache.org,45885,1689178459339': 2023-07-12 16:15:43,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-12 16:15:43,541 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-12 16:15:43,541 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:15:43,541 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:15:43,541 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,542 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:15:43,543 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,543 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,543 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,543 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:43,543 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:43,543 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:43,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:43,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:43,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:43,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:43,544 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:43,544 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:43,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:43,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:43,545 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:43,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:43,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,545 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:43,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:43,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:43,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,547 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:43,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:43,547 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:43,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:43,547 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,549 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,550 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,550 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:43,550 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:43,550 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:43,550 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:43,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:43,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:43,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:43,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:43,550 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:43,550 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,550 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:43,550 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:43,550 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:43,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:43,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:43,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:43,550 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,550 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:15:43,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:43,550 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:43,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:43,551 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,551 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:15:43,551 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:15:43,551 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:43,551 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:43,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,588 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:43,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 16:15:43,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:15:43,589 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:15:43,592 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-12 16:15:43,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,592 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689178543484Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689178543550 (+66 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689178543551 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689178543554 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689178543564 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689178543592 (+28 ms) 2023-07-12 16:15:43,595 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 16:15:43,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 108 msec 2023-07-12 16:15:43,789 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:43,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 16:15:43,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:15:43,790 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178543790 2023-07-12 16:15:43,791 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39241, tgtDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178543790, rawTgtDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178543790, srcFsUri=hdfs://localhost:39241, srcDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:15:43,813 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39241, inputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:15:43,814 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-936383311_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178543790, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178543790/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,814 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39241, inputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca, snapshotDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-12 16:15:43,829 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178543790/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,884 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:43,885 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:43,885 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:43,885 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:43,937 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:15:44,931 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop-1168177094403271096.jar 2023-07-12 16:15:44,932 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:44,932 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:45,034 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop-5808045067094884840.jar 2023-07-12 16:15:45,035 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:45,035 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:45,036 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:45,036 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:45,036 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:45,037 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:45,037 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 16:15:45,038 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 16:15:45,038 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 16:15:45,038 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 16:15:45,039 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 16:15:45,039 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 16:15:45,039 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 16:15:45,040 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 16:15:45,040 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 16:15:45,041 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 16:15:45,041 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:45,041 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:45,042 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:45,042 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:45,042 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:45,043 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:45,044 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:46,497 WARN [Listener at jenkins-hbase5.apache.org/43841] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 16:15:46,500 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-12 16:15:46,502 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-12 16:15:46,604 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:15:46,604 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:15:47,101 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0005_000001 (auth:SIMPLE) 2023-07-12 16:15:53,135 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0005_000001 (auth:SIMPLE) 2023-07-12 16:15:55,492 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0005_000001 (auth:SIMPLE) 2023-07-12 16:16:00,884 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0005_000001 (auth:SIMPLE) 2023-07-12 16:16:02,795 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 16:16:02,797 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 16:16:02,807 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:02,807 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 16:16:02,808 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 16:16:02,808 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1856420832_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:02,808 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 16:16:02,809 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 16:16:02,809 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1856420832_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178543790/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178543790/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:02,809 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178543790/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 16:16:02,809 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178543790/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 16:16:02,816 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:02,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:02,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:02,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 16:16:02,827 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178562827"}]},"ts":"1689178562827"} 2023-07-12 16:16:02,828 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-12 16:16:02,830 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-12 16:16:02,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b9ca029f5ae48b219c7c2f4b1fd79f29, UNASSIGN}] 2023-07-12 16:16:02,833 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b9ca029f5ae48b219c7c2f4b1fd79f29, UNASSIGN 2023-07-12 16:16:02,834 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b9ca029f5ae48b219c7c2f4b1fd79f29, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:02,834 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689178562834"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178562834"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178562834"}]},"ts":"1689178562834"} 2023-07-12 16:16:02,836 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure b9ca029f5ae48b219c7c2f4b1fd79f29, server=jenkins-hbase5.apache.org,45885,1689178459339}] 2023-07-12 16:16:02,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 16:16:02,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close b9ca029f5ae48b219c7c2f4b1fd79f29 2023-07-12 16:16:02,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing b9ca029f5ae48b219c7c2f4b1fd79f29, disabling compactions & flushes 2023-07-12 16:16:02,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29. 2023-07-12 16:16:02,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29. 2023-07-12 16:16:02,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29. after waiting 0 ms 2023-07-12 16:16:02,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29. 2023-07-12 16:16:03,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-12 16:16:03,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:16:03,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29. 2023-07-12 16:16:03,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for b9ca029f5ae48b219c7c2f4b1fd79f29: 2023-07-12 16:16:03,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed b9ca029f5ae48b219c7c2f4b1fd79f29 2023-07-12 16:16:03,003 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b9ca029f5ae48b219c7c2f4b1fd79f29, regionState=CLOSED 2023-07-12 16:16:03,003 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689178563003"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178563003"}]},"ts":"1689178563003"} 2023-07-12 16:16:03,006 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-12 16:16:03,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure b9ca029f5ae48b219c7c2f4b1fd79f29, server=jenkins-hbase5.apache.org,45885,1689178459339 in 169 msec 2023-07-12 16:16:03,008 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-12 16:16:03,008 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b9ca029f5ae48b219c7c2f4b1fd79f29, UNASSIGN in 176 msec 2023-07-12 16:16:03,009 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178563009"}]},"ts":"1689178563009"} 2023-07-12 16:16:03,010 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-12 16:16:03,013 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-12 16:16:03,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 197 msec 2023-07-12 16:16:03,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 16:16:03,129 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-12 16:16:03,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,133 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,134 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,135 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38727] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,138 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,139 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,139 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,139 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 16:16:03,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 16:16:03,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 16:16:03,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 16:16:03,147 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,147 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:03,147 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,147 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:03,147 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,147 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,147 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:03,147 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:03,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:03,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:03,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:03,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:03,149 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29 2023-07-12 16:16:03,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 16:16:03,158 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145 2023-07-12 16:16:03,158 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966 2023-07-12 16:16:03,166 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/cf, FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/recovered.edits] 2023-07-12 16:16:03,167 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/cf, FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/recovered.edits] 2023-07-12 16:16:03,168 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/cf, FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/recovered.edits] 2023-07-12 16:16:03,173 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/cf/288b76fb3b594f918873945a7f91f1f6.120c449bd918eae67eca44c760d1d966 to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/cf/288b76fb3b594f918873945a7f91f1f6.120c449bd918eae67eca44c760d1d966 2023-07-12 16:16:03,173 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/cf/4b81075f9fb64183a879d2911850f9cd to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/cf/4b81075f9fb64183a879d2911850f9cd 2023-07-12 16:16:03,183 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/cf/288b76fb3b594f918873945a7f91f1f6 to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/cf/288b76fb3b594f918873945a7f91f1f6 2023-07-12 16:16:03,183 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/cf/4b81075f9fb64183a879d2911850f9cd.3d0c2f0a21401909c8b960ebb02d0145 to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/cf/4b81075f9fb64183a879d2911850f9cd.3d0c2f0a21401909c8b960ebb02d0145 2023-07-12 16:16:03,185 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/recovered.edits/8.seqid to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145/recovered.edits/8.seqid 2023-07-12 16:16:03,185 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3d0c2f0a21401909c8b960ebb02d0145 2023-07-12 16:16:03,188 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/recovered.edits/8.seqid to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966/recovered.edits/8.seqid 2023-07-12 16:16:03,188 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/recovered.edits/12.seqid to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29/recovered.edits/12.seqid 2023-07-12 16:16:03,188 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/120c449bd918eae67eca44c760d1d966 2023-07-12 16:16:03,188 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b9ca029f5ae48b219c7c2f4b1fd79f29 2023-07-12 16:16:03,188 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 16:16:03,191 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,197 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-12 16:16:03,199 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-12 16:16:03,200 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,200 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-12 16:16:03,200 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178563200"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:03,202 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-12 16:16:03,202 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b9ca029f5ae48b219c7c2f4b1fd79f29, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689178540650.b9ca029f5ae48b219c7c2f4b1fd79f29.', STARTKEY => '', ENDKEY => ''}] 2023-07-12 16:16:03,202 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-12 16:16:03,202 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689178563202"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:03,204 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-12 16:16:03,206 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 76 msec 2023-07-12 16:16:03,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 16:16:03,251 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-12 16:16:03,251 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 16:16:03,257 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178563257"}]},"ts":"1689178563257"} 2023-07-12 16:16:03,259 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-12 16:16:03,261 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-12 16:16:03,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=54cecc48a60e599a500331808534ec66, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f2fde191367a7517bb75fbabb2df5a39, UNASSIGN}] 2023-07-12 16:16:03,263 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=54cecc48a60e599a500331808534ec66, UNASSIGN 2023-07-12 16:16:03,264 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f2fde191367a7517bb75fbabb2df5a39, UNASSIGN 2023-07-12 16:16:03,264 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=54cecc48a60e599a500331808534ec66, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:03,264 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f2fde191367a7517bb75fbabb2df5a39, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:03,264 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178563264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178563264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178563264"}]},"ts":"1689178563264"} 2023-07-12 16:16:03,264 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178563264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178563264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178563264"}]},"ts":"1689178563264"} 2023-07-12 16:16:03,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 54cecc48a60e599a500331808534ec66, server=jenkins-hbase5.apache.org,38727,1689178459459}] 2023-07-12 16:16:03,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure f2fde191367a7517bb75fbabb2df5a39, server=jenkins-hbase5.apache.org,36809,1689178459409}] 2023-07-12 16:16:03,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 16:16:03,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 54cecc48a60e599a500331808534ec66 2023-07-12 16:16:03,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 54cecc48a60e599a500331808534ec66, disabling compactions & flushes 2023-07-12 16:16:03,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:16:03,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:16:03,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. after waiting 0 ms 2023-07-12 16:16:03,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:16:03,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close f2fde191367a7517bb75fbabb2df5a39 2023-07-12 16:16:03,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing f2fde191367a7517bb75fbabb2df5a39, disabling compactions & flushes 2023-07-12 16:16:03,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. 2023-07-12 16:16:03,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. 2023-07-12 16:16:03,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. after waiting 0 ms 2023-07-12 16:16:03,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. 2023-07-12 16:16:03,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:16:03,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:16:03,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:16:03,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66. 2023-07-12 16:16:03,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 54cecc48a60e599a500331808534ec66: 2023-07-12 16:16:03,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:16:03,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39. 2023-07-12 16:16:03,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for f2fde191367a7517bb75fbabb2df5a39: 2023-07-12 16:16:03,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 54cecc48a60e599a500331808534ec66 2023-07-12 16:16:03,444 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=54cecc48a60e599a500331808534ec66, regionState=CLOSED 2023-07-12 16:16:03,444 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178563444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178563444"}]},"ts":"1689178563444"} 2023-07-12 16:16:03,445 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f2fde191367a7517bb75fbabb2df5a39, regionState=CLOSED 2023-07-12 16:16:03,445 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178563445"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178563445"}]},"ts":"1689178563445"} 2023-07-12 16:16:03,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed f2fde191367a7517bb75fbabb2df5a39 2023-07-12 16:16:03,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-12 16:16:03,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 54cecc48a60e599a500331808534ec66, server=jenkins-hbase5.apache.org,38727,1689178459459 in 180 msec 2023-07-12 16:16:03,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=54cecc48a60e599a500331808534ec66, UNASSIGN in 189 msec 2023-07-12 16:16:03,451 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-12 16:16:03,451 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure f2fde191367a7517bb75fbabb2df5a39, server=jenkins-hbase5.apache.org,36809,1689178459409 in 182 msec 2023-07-12 16:16:03,456 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-12 16:16:03,456 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f2fde191367a7517bb75fbabb2df5a39, UNASSIGN in 190 msec 2023-07-12 16:16:03,456 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178563456"}]},"ts":"1689178563456"} 2023-07-12 16:16:03,458 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-12 16:16:03,460 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-12 16:16:03,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 208 msec 2023-07-12 16:16:03,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 16:16:03,560 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-12 16:16:03,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,564 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,565 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,566 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38727] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,570 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66 2023-07-12 16:16:03,570 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39 2023-07-12 16:16:03,570 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,570 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,570 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,570 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,571 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 16:16:03,571 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 16:16:03,571 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 16:16:03,572 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 16:16:03,573 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,573 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:03,573 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,573 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:03,573 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,573 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:03,573 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,573 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:03,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 16:16:03,574 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/cf, FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/recovered.edits] 2023-07-12 16:16:03,575 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/cf, FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/recovered.edits] 2023-07-12 16:16:03,583 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/cf/7e03aff5929742069f12df05ea5dff6a to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/cf/7e03aff5929742069f12df05ea5dff6a 2023-07-12 16:16:03,585 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/cf/c5236608fb5349b396c3a8278b7efb3d to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/cf/c5236608fb5349b396c3a8278b7efb3d 2023-07-12 16:16:03,586 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/recovered.edits/9.seqid to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66/recovered.edits/9.seqid 2023-07-12 16:16:03,587 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/54cecc48a60e599a500331808534ec66 2023-07-12 16:16:03,589 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/recovered.edits/9.seqid to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39/recovered.edits/9.seqid 2023-07-12 16:16:03,589 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f2fde191367a7517bb75fbabb2df5a39 2023-07-12 16:16:03,589 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 16:16:03,592 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,598 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-12 16:16:03,607 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-12 16:16:03,608 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,609 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-12 16:16:03,609 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178563609"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:03,609 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178563609"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:03,611 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 16:16:03,611 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 54cecc48a60e599a500331808534ec66, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689178538857.54cecc48a60e599a500331808534ec66.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f2fde191367a7517bb75fbabb2df5a39, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689178538857.f2fde191367a7517bb75fbabb2df5a39.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 16:16:03,611 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-12 16:16:03,611 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689178563611"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:03,613 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-12 16:16:03,615 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 54 msec 2023-07-12 16:16:03,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 16:16:03,676 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-12 16:16:03,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 16:16:03,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 16:16:03,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:03,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-12 16:16:03,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,722 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 747) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1856420832_17 at /127.0.0.1:33972 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1856420832_17 at /127.0.0.1:53464 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1856420832_17 at /127.0.0.1:43546 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_184167338_1 at /127.0.0.1:33942 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase5.apache.org/172.31.10.131:34331 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3946 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=584 (was 418) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=3627 (was 4330) 2023-07-12 16:16:03,722 WARN [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-12 16:16:03,746 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=584, ProcessCount=171, AvailableMemoryMB=3627 2023-07-12 16:16:03,746 WARN [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-12 16:16:03,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 16:16:03,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:03,751 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:16:03,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-12 16:16:03,752 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:16:03,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 16:16:03,754 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a 2023-07-12 16:16:03,754 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e 2023-07-12 16:16:03,755 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e empty. 2023-07-12 16:16:03,755 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a empty. 2023-07-12 16:16:03,755 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e 2023-07-12 16:16:03,756 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a 2023-07-12 16:16:03,756 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 16:16:03,766 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 16:16:03,768 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0b0e3a9d6a659429e5f5cdea8ea0602a, NAME => 'testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:16:03,768 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4cd1b678c4cb1e702ece9ad630a6a59e, NAME => 'testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:16:03,788 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:03,788 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 0b0e3a9d6a659429e5f5cdea8ea0602a, disabling compactions & flushes 2023-07-12 16:16:03,788 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:03,788 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:03,789 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. after waiting 0 ms 2023-07-12 16:16:03,789 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:03,789 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:03,789 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 0b0e3a9d6a659429e5f5cdea8ea0602a: 2023-07-12 16:16:03,789 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:03,789 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 4cd1b678c4cb1e702ece9ad630a6a59e, disabling compactions & flushes 2023-07-12 16:16:03,789 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. 2023-07-12 16:16:03,789 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. 2023-07-12 16:16:03,789 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. after waiting 0 ms 2023-07-12 16:16:03,789 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. 2023-07-12 16:16:03,789 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. 2023-07-12 16:16:03,789 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 4cd1b678c4cb1e702ece9ad630a6a59e: 2023-07-12 16:16:03,792 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:16:03,793 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178563793"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178563793"}]},"ts":"1689178563793"} 2023-07-12 16:16:03,793 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178563793"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178563793"}]},"ts":"1689178563793"} 2023-07-12 16:16:03,796 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 16:16:03,797 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:16:03,797 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178563797"}]},"ts":"1689178563797"} 2023-07-12 16:16:03,800 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 16:16:03,804 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:16:03,805 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:16:03,805 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:16:03,805 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:16:03,805 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:16:03,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0b0e3a9d6a659429e5f5cdea8ea0602a, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4cd1b678c4cb1e702ece9ad630a6a59e, ASSIGN}] 2023-07-12 16:16:03,808 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4cd1b678c4cb1e702ece9ad630a6a59e, ASSIGN 2023-07-12 16:16:03,808 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0b0e3a9d6a659429e5f5cdea8ea0602a, ASSIGN 2023-07-12 16:16:03,809 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4cd1b678c4cb1e702ece9ad630a6a59e, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,36809,1689178459409; forceNewPlan=false, retain=false 2023-07-12 16:16:03,809 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0b0e3a9d6a659429e5f5cdea8ea0602a, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,45885,1689178459339; forceNewPlan=false, retain=false 2023-07-12 16:16:03,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 16:16:03,959 INFO [jenkins-hbase5:41835] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 16:16:03,963 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=4cd1b678c4cb1e702ece9ad630a6a59e, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:03,963 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0b0e3a9d6a659429e5f5cdea8ea0602a, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:03,963 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178563962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178563962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178563962"}]},"ts":"1689178563962"} 2023-07-12 16:16:03,963 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178563962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178563962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178563962"}]},"ts":"1689178563962"} 2023-07-12 16:16:03,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 4cd1b678c4cb1e702ece9ad630a6a59e, server=jenkins-hbase5.apache.org,36809,1689178459409}] 2023-07-12 16:16:03,965 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 0b0e3a9d6a659429e5f5cdea8ea0602a, server=jenkins-hbase5.apache.org,45885,1689178459339}] 2023-07-12 16:16:04,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 16:16:04,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. 2023-07-12 16:16:04,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4cd1b678c4cb1e702ece9ad630a6a59e, NAME => 'testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 16:16:04,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. service=AccessControlService 2023-07-12 16:16:04,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:04,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:16:04,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b0e3a9d6a659429e5f5cdea8ea0602a, NAME => 'testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 16:16:04,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 4cd1b678c4cb1e702ece9ad630a6a59e 2023-07-12 16:16:04,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:04,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 4cd1b678c4cb1e702ece9ad630a6a59e 2023-07-12 16:16:04,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 4cd1b678c4cb1e702ece9ad630a6a59e 2023-07-12 16:16:04,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. service=AccessControlService 2023-07-12 16:16:04,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:16:04,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 0b0e3a9d6a659429e5f5cdea8ea0602a 2023-07-12 16:16:04,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:04,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 0b0e3a9d6a659429e5f5cdea8ea0602a 2023-07-12 16:16:04,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 0b0e3a9d6a659429e5f5cdea8ea0602a 2023-07-12 16:16:04,122 INFO [StoreOpener-4cd1b678c4cb1e702ece9ad630a6a59e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4cd1b678c4cb1e702ece9ad630a6a59e 2023-07-12 16:16:04,122 INFO [StoreOpener-0b0e3a9d6a659429e5f5cdea8ea0602a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0b0e3a9d6a659429e5f5cdea8ea0602a 2023-07-12 16:16:04,123 DEBUG [StoreOpener-4cd1b678c4cb1e702ece9ad630a6a59e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/cf 2023-07-12 16:16:04,123 DEBUG [StoreOpener-4cd1b678c4cb1e702ece9ad630a6a59e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/cf 2023-07-12 16:16:04,124 INFO [StoreOpener-4cd1b678c4cb1e702ece9ad630a6a59e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4cd1b678c4cb1e702ece9ad630a6a59e columnFamilyName cf 2023-07-12 16:16:04,124 DEBUG [StoreOpener-0b0e3a9d6a659429e5f5cdea8ea0602a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/cf 2023-07-12 16:16:04,124 DEBUG [StoreOpener-0b0e3a9d6a659429e5f5cdea8ea0602a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/cf 2023-07-12 16:16:04,124 INFO [StoreOpener-0b0e3a9d6a659429e5f5cdea8ea0602a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b0e3a9d6a659429e5f5cdea8ea0602a columnFamilyName cf 2023-07-12 16:16:04,124 INFO [StoreOpener-4cd1b678c4cb1e702ece9ad630a6a59e-1] regionserver.HStore(310): Store=4cd1b678c4cb1e702ece9ad630a6a59e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:16:04,125 INFO [StoreOpener-0b0e3a9d6a659429e5f5cdea8ea0602a-1] regionserver.HStore(310): Store=0b0e3a9d6a659429e5f5cdea8ea0602a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:16:04,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e 2023-07-12 16:16:04,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e 2023-07-12 16:16:04,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a 2023-07-12 16:16:04,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a 2023-07-12 16:16:04,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 0b0e3a9d6a659429e5f5cdea8ea0602a 2023-07-12 16:16:04,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 4cd1b678c4cb1e702ece9ad630a6a59e 2023-07-12 16:16:04,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:16:04,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 0b0e3a9d6a659429e5f5cdea8ea0602a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70863116, jitterRate=0.05594271421432495}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:16:04,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 0b0e3a9d6a659429e5f5cdea8ea0602a: 2023-07-12 16:16:04,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:16:04,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 4cd1b678c4cb1e702ece9ad630a6a59e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67989007, jitterRate=0.013115152716636658}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:16:04,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 4cd1b678c4cb1e702ece9ad630a6a59e: 2023-07-12 16:16:04,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a., pid=94, masterSystemTime=1689178564117 2023-07-12 16:16:04,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e., pid=93, masterSystemTime=1689178564116 2023-07-12 16:16:04,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:04,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:04,141 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0b0e3a9d6a659429e5f5cdea8ea0602a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. 2023-07-12 16:16:04,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. 2023-07-12 16:16:04,141 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178564140"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178564140"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178564140"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178564140"}]},"ts":"1689178564140"} 2023-07-12 16:16:04,141 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=4cd1b678c4cb1e702ece9ad630a6a59e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,141 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178564141"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178564141"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178564141"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178564141"}]},"ts":"1689178564141"} 2023-07-12 16:16:04,147 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-12 16:16:04,147 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 0b0e3a9d6a659429e5f5cdea8ea0602a, server=jenkins-hbase5.apache.org,45885,1689178459339 in 177 msec 2023-07-12 16:16:04,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-12 16:16:04,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 4cd1b678c4cb1e702ece9ad630a6a59e, server=jenkins-hbase5.apache.org,36809,1689178459409 in 179 msec 2023-07-12 16:16:04,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0b0e3a9d6a659429e5f5cdea8ea0602a, ASSIGN in 342 msec 2023-07-12 16:16:04,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-12 16:16:04,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4cd1b678c4cb1e702ece9ad630a6a59e, ASSIGN in 343 msec 2023-07-12 16:16:04,151 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:16:04,151 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178564151"}]},"ts":"1689178564151"} 2023-07-12 16:16:04,152 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 16:16:04,155 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:16:04,156 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-12 16:16:04,157 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38727] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 16:16:04,159 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:04,159 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:04,159 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:04,159 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:04,160 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:04,161 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:04,161 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:04,161 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:04,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 413 msec 2023-07-12 16:16:04,281 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-12 16:16:04,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 16:16:04,356 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-12 16:16:04,357 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-12 16:16:04,357 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:16:04,371 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-12 16:16:04,372 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:16:04,372 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-12 16:16:04,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:16:04,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178564375 (current time:1689178564375). 2023-07-12 16:16:04,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:16:04,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x5439ce03 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:04,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@493241d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:04,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:04,395 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:45514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:04,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5439ce03 to 127.0.0.1:62419 2023-07-12 16:16:04,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:04,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x5bc49df6 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:04,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4117095b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:04,411 DEBUG [hconnection-0x1a70ec68-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:04,415 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:45516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:04,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bc49df6 to 127.0.0.1:62419 2023-07-12 16:16:04,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:04,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 16:16:04,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:16:04,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:16:04,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:16:04,424 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:16:04,424 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689179164424 2023-07-12 16:16:04,424 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 16:16:04,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:16:04,426 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:16:04,426 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:16:04,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 16:16:04,427 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:16:04,428 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-12 16:16:04,431 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 16:16:04,432 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689179164432 2023-07-12 16:16:04,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,441 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-12 16:16:04,441 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:04,442 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 16:16:04,442 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 16:16:04,443 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,443 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,448 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:04,448 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:04,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:04,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:04,448 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:04,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:04,448 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:04,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:04,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:04,449 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,449 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,449 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,449 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:16:04,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 16:16:04,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 16:16:04,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,450 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 16:16:04,450 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 16:16:04,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,450 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 16:16:04,450 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:04,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,451 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 16:16:04,451 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 16:16:04,451 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 16:16:04,451 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 16:16:04,451 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:04,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 16:16:04,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,453 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 16:16:04,453 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 16:16:04,453 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 16:16:04,453 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 16:16:04,453 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,453 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 16:16:04,453 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:04,455 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 16:16:04,455 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 16:16:04,455 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 16:16:04,455 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,455 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:04,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:04,456 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,456 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:04,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:04,456 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,461 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,461 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,461 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:04,461 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:04,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,462 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,462 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:04,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:04,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:04,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 16:16:04,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@230b83f1[Count = 1] remaining members to acquire global barrier 2023-07-12 16:16:04,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:04,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:04,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:04,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:04,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:04,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:04,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 16:16:04,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@230b83f1[Count = 0] remaining members to acquire global barrier 2023-07-12 16:16:04,467 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 16:16:04,467 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,468 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,468 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,468 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,469 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:16:04,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,469 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,469 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:16:04,469 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:16:04,469 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 16:16:04,469 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,38727,1689178459459' in zk 2023-07-12 16:16:04,470 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,470 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:16:04,470 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:04,470 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. 2023-07-12 16:16:04,470 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:04,470 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:04,470 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:04,470 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:04,470 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. started... 2023-07-12 16:16:04,470 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. started... 2023-07-12 16:16:04,472 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4cd1b678c4cb1e702ece9ad630a6a59e: 2023-07-12 16:16:04,475 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 16:16:04,475 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:04,475 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 16:16:04,482 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b0e3a9d6a659429e5f5cdea8ea0602a: 2023-07-12 16:16:04,482 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,482 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:04,482 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,482 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:16:04,482 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:04,483 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:16:04,526 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:04,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:16:04,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:16:04,539 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. completed. 2023-07-12 16:16:04,539 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. 2023-07-12 16:16:04,539 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:04,539 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:04,539 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,539 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 16:16:04,539 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,36809,1689178459409' in zk 2023-07-12 16:16:04,540 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:16:04,540 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. completed. 2023-07-12 16:16:04,540 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:04,540 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:04,540 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:04,540 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,540 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 16:16:04,540 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,45885,1689178459339' in zk 2023-07-12 16:16:04,541 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,541 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 16:16:04,541 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:04,541 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 16:16:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:04,546 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:04,546 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 16:16:04,547 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:04,547 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 16:16:04,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:04,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:04,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:04,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:04,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase5.apache.org,36809,1689178459409': 2023-07-12 16:16:04,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 16:16:04,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:04,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:04,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:04,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:04,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:04,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:04,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:04,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase5.apache.org,45885,1689178459339': 2023-07-12 16:16:04,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 16:16:04,597 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 16:16:04,597 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:16:04,597 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:16:04,597 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,597 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:16:04,599 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,599 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,599 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,599 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:04,599 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:04,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,599 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,599 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:04,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:04,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:04,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:04,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:04,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:04,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:04,600 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:04,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,601 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:04,601 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:04,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:04,605 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:04,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,605 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:04,606 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,612 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:04,612 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,612 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:04,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:04,612 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:04,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:04,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:04,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:04,612 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,612 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:04,613 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:04,613 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,612 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:04,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:04,613 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:04,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:04,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:04,613 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:04,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:04,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:04,615 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:04,615 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,615 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,615 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,615 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,615 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:04,615 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,615 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:04,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:04,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,687 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 16:16:04,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,687 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689178564424Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689178564614 (+190 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689178564614Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689178564624 (+10 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689178564641 (+17 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689178564687 (+46 ms) 2023-07-12 16:16:04,691 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 16:16:04,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 267 msec 2023-07-12 16:16:04,740 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:04,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:16:04,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:16:04,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:16:04,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36809] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:16:04,769 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 16:16:04,769 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:04,770 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:16:04,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:16:04,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178564781 (current time:1689178564781). 2023-07-12 16:16:04,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:16:04,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x52bfd0c1 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:04,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fb16552, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:04,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:04,834 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:45524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:04,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52bfd0c1 to 127.0.0.1:62419 2023-07-12 16:16:04,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:04,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x10584ac5 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:04,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ccdb9d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:04,863 DEBUG [hconnection-0x7892d0e9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:04,866 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:45526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:04,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10584ac5 to 127.0.0.1:62419 2023-07-12 16:16:04,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:04,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 16:16:04,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:16:04,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:16:04,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:16:04,878 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:16:04,879 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689179164879 2023-07-12 16:16:04,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:16:04,879 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 16:16:04,881 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:16:04,881 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:16:04,882 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:16:04,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 16:16:04,883 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-12 16:16:04,884 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 16:16:04,884 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689179164884 2023-07-12 16:16:04,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,915 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-12 16:16:04,915 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:04,917 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 16:16:04,917 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 16:16:04,917 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,917 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,919 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:04,919 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:04,919 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:04,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:04,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:04,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:04,920 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,921 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,921 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,921 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,921 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:16:04,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 16:16:04,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 16:16:04,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,921 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 16:16:04,921 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 16:16:04,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 16:16:04,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,922 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 16:16:04,922 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 16:16:04,922 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:04,922 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:04,922 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 16:16:04,925 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 16:16:04,925 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 16:16:04,924 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 16:16:04,925 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 16:16:04,925 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 16:16:04,925 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 16:16:04,928 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,928 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,928 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,928 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,928 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 16:16:04,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:04,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:04,928 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:04,928 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,933 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 16:16:04,933 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 16:16:04,928 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,933 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:04,928 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,933 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 16:16:04,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:04,933 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:04,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:04,935 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,935 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,935 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:04,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:04,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:04,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 16:16:04,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b4da459[Count = 1] remaining members to acquire global barrier 2023-07-12 16:16:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:04,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:04,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:04,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:04,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:04,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:04,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 16:16:04,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b4da459[Count = 0] remaining members to acquire global barrier 2023-07-12 16:16:04,942 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 16:16:04,942 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,946 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,946 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,946 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,947 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:16:04,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,947 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:04,947 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:16:04,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,947 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 16:16:04,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:04,947 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,38727,1689178459459' in zk 2023-07-12 16:16:04,947 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:16:04,947 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:04,947 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. 2023-07-12 16:16:04,947 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:04,947 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:04,947 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:04,947 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:04,947 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:04,947 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. started... 2023-07-12 16:16:04,947 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. started... 2023-07-12 16:16:04,947 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:16:04,948 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0b0e3a9d6a659429e5f5cdea8ea0602a 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-12 16:16:04,948 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4cd1b678c4cb1e702ece9ad630a6a59e 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-12 16:16:04,949 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 16:16:04,949 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:04,949 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 16:16:04,978 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/.tmp/cf/d81b734d11984e9983ced65a17e17cd8 2023-07-12 16:16:04,981 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/.tmp/cf/e26f096d826645c7b66e0951306fb37e 2023-07-12 16:16:04,981 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:04,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:16:04,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:16:04,983 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:16:04,987 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/.tmp/cf/d81b734d11984e9983ced65a17e17cd8 as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/cf/d81b734d11984e9983ced65a17e17cd8 2023-07-12 16:16:04,990 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/.tmp/cf/e26f096d826645c7b66e0951306fb37e as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/cf/e26f096d826645c7b66e0951306fb37e 2023-07-12 16:16:05,000 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/cf/e26f096d826645c7b66e0951306fb37e, entries=6, sequenceid=6, filesize=5.2 K 2023-07-12 16:16:05,000 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/cf/d81b734d11984e9983ced65a17e17cd8, entries=44, sequenceid=6, filesize=7.8 K 2023-07-12 16:16:05,001 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 0b0e3a9d6a659429e5f5cdea8ea0602a in 53ms, sequenceid=6, compaction requested=false 2023-07-12 16:16:05,001 INFO [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 4cd1b678c4cb1e702ece9ad630a6a59e in 53ms, sequenceid=6, compaction requested=false 2023-07-12 16:16:05,003 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b0e3a9d6a659429e5f5cdea8ea0602a: 2023-07-12 16:16:05,003 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4cd1b678c4cb1e702ece9ad630a6a59e: 2023-07-12 16:16:05,003 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,003 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,003 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:05,003 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/cf/d81b734d11984e9983ced65a17e17cd8] hfiles 2023-07-12 16:16:05,003 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/cf/d81b734d11984e9983ced65a17e17cd8 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,003 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:05,004 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/cf/e26f096d826645c7b66e0951306fb37e] hfiles 2023-07-12 16:16:05,004 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/cf/e26f096d826645c7b66e0951306fb37e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,071 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. completed. 2023-07-12 16:16:05,071 DEBUG [rs(jenkins-hbase5.apache.org,36809,1689178459409)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. 2023-07-12 16:16:05,071 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:05,071 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:05,071 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:05,075 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 16:16:05,075 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,36809,1689178459409' in zk 2023-07-12 16:16:05,077 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 16:16:05,077 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:05,077 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:05,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:05,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:05,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:05,077 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 16:16:05,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:05,080 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. completed. 2023-07-12 16:16:05,080 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:05,080 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:05,080 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:05,080 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:05,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:05,080 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 16:16:05,080 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,45885,1689178459339' in zk 2023-07-12 16:16:05,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:05,081 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 16:16:05,081 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:05,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:05,082 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:05,082 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 16:16:05,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:05,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:05,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:05,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:05,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:05,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase5.apache.org,36809,1689178459409': 2023-07-12 16:16:05,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 16:16:05,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:05,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:05,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:05,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:05,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:05,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:05,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:05,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:05,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:05,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:05,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:05,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:05,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase5.apache.org,45885,1689178459339': 2023-07-12 16:16:05,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 16:16:05,089 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 16:16:05,089 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:16:05,089 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:16:05,089 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,089 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:16:05,092 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,092 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,092 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:05,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:05,092 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,092 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,092 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,092 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:05,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,096 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:05,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,096 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:05,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:05,097 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:05,099 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,099 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:05,100 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:05,103 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:05,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:05,103 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:05,103 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,103 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:05,103 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:05,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:05,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:05,103 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:05,103 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,103 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,104 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:05,104 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,104 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:05,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,105 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:05,106 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,106 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:05,106 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,106 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:05,106 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:05,106 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,106 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,183 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:05,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:16:05,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:16:05,184 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 16:16:05,484 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:05,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:16:05,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:16:05,486 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 16:16:05,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,580 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 16:16:05,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,580 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689178564879Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689178565105 (+226 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689178565106 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689178565112 (+6 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689178565536 (+424 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689178565580 (+44 ms) 2023-07-12 16:16:05,583 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 16:16:05,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 702 msec 2023-07-12 16:16:05,986 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:05,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:16:05,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:16:05,988 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178565988 2023-07-12 16:16:05,988 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39241, tgtDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178565988, rawTgtDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178565988, srcFsUri=hdfs://localhost:39241, srcDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:16:06,023 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39241, inputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:16:06,023 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1656706753_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178565988, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178565988/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:06,023 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39241, inputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca, snapshotDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-12 16:16:06,033 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178565988/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:06,068 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:06,068 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:06,069 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:06,069 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,107 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0005_000001 (auth:SIMPLE) 2023-07-12 16:16:07,249 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop-4857711335152818233.jar 2023-07-12 16:16:07,250 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,250 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,336 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop-2185761396049023747.jar 2023-07-12 16:16:07,337 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,337 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,338 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,338 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,339 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,339 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,339 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 16:16:07,340 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 16:16:07,341 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 16:16:07,341 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 16:16:07,342 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 16:16:07,343 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 16:16:07,343 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 16:16:07,344 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 16:16:07,344 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 16:16:07,345 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 16:16:07,346 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:07,346 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:07,347 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:16:07,348 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:07,350 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:07,351 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:16:07,351 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:16:08,540 WARN [Listener at jenkins-hbase5.apache.org/43841] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 16:16:08,543 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-12 16:16:08,666 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:16:08,816 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:16:08,816 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:16:09,113 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0006_000001 (auth:SIMPLE) 2023-07-12 16:16:16,068 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0006_000001 (auth:SIMPLE) 2023-07-12 16:16:18,971 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 16:16:18,972 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 16:16:18,979 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:18,979 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 16:16:18,979 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 16:16:18,980 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1856420832_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:18,980 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 16:16:18,980 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 16:16:18,980 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1856420832_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178565988/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178565988/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:18,981 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178565988/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 16:16:18,981 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178565988/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 16:16:18,988 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-12 16:16:18,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testEmptyExportFileSystemState 2023-07-12 16:16:18,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:18,994 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178578993"}]},"ts":"1689178578993"} 2023-07-12 16:16:18,995 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 16:16:19,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 16:16:19,001 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-12 16:16:19,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0b0e3a9d6a659429e5f5cdea8ea0602a, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4cd1b678c4cb1e702ece9ad630a6a59e, UNASSIGN}] 2023-07-12 16:16:19,007 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4cd1b678c4cb1e702ece9ad630a6a59e, UNASSIGN 2023-07-12 16:16:19,007 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0b0e3a9d6a659429e5f5cdea8ea0602a, UNASSIGN 2023-07-12 16:16:19,008 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=4cd1b678c4cb1e702ece9ad630a6a59e, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:19,008 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0b0e3a9d6a659429e5f5cdea8ea0602a, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:19,008 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178579008"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178579008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178579008"}]},"ts":"1689178579008"} 2023-07-12 16:16:19,008 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178579008"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178579008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178579008"}]},"ts":"1689178579008"} 2023-07-12 16:16:19,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 4cd1b678c4cb1e702ece9ad630a6a59e, server=jenkins-hbase5.apache.org,36809,1689178459409}] 2023-07-12 16:16:19,012 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 0b0e3a9d6a659429e5f5cdea8ea0602a, server=jenkins-hbase5.apache.org,45885,1689178459339}] 2023-07-12 16:16:19,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 16:16:19,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 4cd1b678c4cb1e702ece9ad630a6a59e 2023-07-12 16:16:19,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 4cd1b678c4cb1e702ece9ad630a6a59e, disabling compactions & flushes 2023-07-12 16:16:19,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. 2023-07-12 16:16:19,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. 2023-07-12 16:16:19,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. after waiting 0 ms 2023-07-12 16:16:19,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. 2023-07-12 16:16:19,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 0b0e3a9d6a659429e5f5cdea8ea0602a 2023-07-12 16:16:19,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 0b0e3a9d6a659429e5f5cdea8ea0602a, disabling compactions & flushes 2023-07-12 16:16:19,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:19,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:19,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. after waiting 0 ms 2023-07-12 16:16:19,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:19,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:16:19,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:16:19,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:16:19,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e. 2023-07-12 16:16:19,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 4cd1b678c4cb1e702ece9ad630a6a59e: 2023-07-12 16:16:19,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:16:19,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a. 2023-07-12 16:16:19,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 0b0e3a9d6a659429e5f5cdea8ea0602a: 2023-07-12 16:16:19,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 4cd1b678c4cb1e702ece9ad630a6a59e 2023-07-12 16:16:19,181 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=4cd1b678c4cb1e702ece9ad630a6a59e, regionState=CLOSED 2023-07-12 16:16:19,181 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178579181"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178579181"}]},"ts":"1689178579181"} 2023-07-12 16:16:19,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 0b0e3a9d6a659429e5f5cdea8ea0602a 2023-07-12 16:16:19,181 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0b0e3a9d6a659429e5f5cdea8ea0602a, regionState=CLOSED 2023-07-12 16:16:19,181 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178579181"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178579181"}]},"ts":"1689178579181"} 2023-07-12 16:16:19,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-12 16:16:19,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 4cd1b678c4cb1e702ece9ad630a6a59e, server=jenkins-hbase5.apache.org,36809,1689178459409 in 172 msec 2023-07-12 16:16:19,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-12 16:16:19,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 0b0e3a9d6a659429e5f5cdea8ea0602a, server=jenkins-hbase5.apache.org,45885,1689178459339 in 171 msec 2023-07-12 16:16:19,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4cd1b678c4cb1e702ece9ad630a6a59e, UNASSIGN in 182 msec 2023-07-12 16:16:19,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-12 16:16:19,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0b0e3a9d6a659429e5f5cdea8ea0602a, UNASSIGN in 183 msec 2023-07-12 16:16:19,187 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178579187"}]},"ts":"1689178579187"} 2023-07-12 16:16:19,189 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 16:16:19,191 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-12 16:16:19,194 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 204 msec 2023-07-12 16:16:19,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 16:16:19,303 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-12 16:16:19,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,307 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,308 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,309 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38727] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,312 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,312 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,312 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,312 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 16:16:19,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 16:16:19,313 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e 2023-07-12 16:16:19,313 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a 2023-07-12 16:16:19,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 16:16:19,315 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,315 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:19,315 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:19,315 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-12 16:16:19,315 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,315 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:19,315 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 16:16:19,315 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:19,316 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/cf, FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/recovered.edits] 2023-07-12 16:16:19,316 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/cf, FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/recovered.edits] 2023-07-12 16:16:19,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 16:16:19,321 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/cf/d81b734d11984e9983ced65a17e17cd8 to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/cf/d81b734d11984e9983ced65a17e17cd8 2023-07-12 16:16:19,321 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/cf/e26f096d826645c7b66e0951306fb37e to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/cf/e26f096d826645c7b66e0951306fb37e 2023-07-12 16:16:19,331 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/recovered.edits/9.seqid to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e/recovered.edits/9.seqid 2023-07-12 16:16:19,331 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/recovered.edits/9.seqid to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a/recovered.edits/9.seqid 2023-07-12 16:16:19,332 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/4cd1b678c4cb1e702ece9ad630a6a59e 2023-07-12 16:16:19,332 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testEmptyExportFileSystemState/0b0e3a9d6a659429e5f5cdea8ea0602a 2023-07-12 16:16:19,332 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 16:16:19,337 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,348 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-12 16:16:19,355 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-12 16:16:19,359 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,359 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-12 16:16:19,359 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178579359"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:19,359 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178579359"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:19,371 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 16:16:19,371 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0b0e3a9d6a659429e5f5cdea8ea0602a, NAME => 'testtb-testEmptyExportFileSystemState,,1689178563748.0b0e3a9d6a659429e5f5cdea8ea0602a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4cd1b678c4cb1e702ece9ad630a6a59e, NAME => 'testtb-testEmptyExportFileSystemState,1,1689178563748.4cd1b678c4cb1e702ece9ad630a6a59e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 16:16:19,371 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-12 16:16:19,371 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689178579371"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:19,397 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-12 16:16:19,400 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 97 msec 2023-07-12 16:16:19,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 16:16:19,418 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-12 16:16:19,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-12 16:16:19,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:19,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-12 16:16:19,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:19,488 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 760) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1856420832_17 at /127.0.0.1:35272 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-662785908_1 at /127.0.0.1:47782 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1856420832_17 at /127.0.0.1:45976 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase5.apache.org/172.31.10.131:39257 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4719 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-662785908_1 at /127.0.0.1:45950 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1856420832_17 at /127.0.0.1:47804 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 913), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=616 (was 584) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 171), AvailableMemoryMB=3602 (was 3627) 2023-07-12 16:16:19,488 WARN [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 16:16:19,545 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=616, ProcessCount=171, AvailableMemoryMB=3597 2023-07-12 16:16:19,545 WARN [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 16:16:19,547 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 16:16:19,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:19,551 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:16:19,551 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-12 16:16:19,552 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:16:19,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 16:16:19,554 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548 2023-07-12 16:16:19,554 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb 2023-07-12 16:16:19,555 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548 empty. 2023-07-12 16:16:19,555 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb empty. 2023-07-12 16:16:19,556 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548 2023-07-12 16:16:19,556 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb 2023-07-12 16:16:19,556 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 16:16:19,589 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-12 16:16:19,591 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => d6297123d321fbcf89c5cc46a2a41548, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:16:19,594 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => eab026cfdc06ae39e820b5468679f3cb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp 2023-07-12 16:16:19,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 16:16:19,722 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:19,722 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing d6297123d321fbcf89c5cc46a2a41548, disabling compactions & flushes 2023-07-12 16:16:19,722 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:19,722 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:19,722 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. after waiting 0 ms 2023-07-12 16:16:19,722 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:19,722 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:19,722 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for d6297123d321fbcf89c5cc46a2a41548: 2023-07-12 16:16:19,733 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:19,733 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing eab026cfdc06ae39e820b5468679f3cb, disabling compactions & flushes 2023-07-12 16:16:19,733 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. 2023-07-12 16:16:19,733 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. 2023-07-12 16:16:19,733 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. after waiting 0 ms 2023-07-12 16:16:19,734 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. 2023-07-12 16:16:19,734 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. 2023-07-12 16:16:19,734 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for eab026cfdc06ae39e820b5468679f3cb: 2023-07-12 16:16:19,736 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:16:19,738 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178579737"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178579737"}]},"ts":"1689178579737"} 2023-07-12 16:16:19,738 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178579737"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178579737"}]},"ts":"1689178579737"} 2023-07-12 16:16:19,740 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 16:16:19,741 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:16:19,741 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178579741"}]},"ts":"1689178579741"} 2023-07-12 16:16:19,743 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-12 16:16:19,746 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:16:19,751 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:16:19,751 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:16:19,751 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:16:19,751 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:16:19,751 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d6297123d321fbcf89c5cc46a2a41548, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=eab026cfdc06ae39e820b5468679f3cb, ASSIGN}] 2023-07-12 16:16:19,754 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=eab026cfdc06ae39e820b5468679f3cb, ASSIGN 2023-07-12 16:16:19,754 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d6297123d321fbcf89c5cc46a2a41548, ASSIGN 2023-07-12 16:16:19,755 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d6297123d321fbcf89c5cc46a2a41548, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,38727,1689178459459; forceNewPlan=false, retain=false 2023-07-12 16:16:19,755 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=eab026cfdc06ae39e820b5468679f3cb, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,45885,1689178459339; forceNewPlan=false, retain=false 2023-07-12 16:16:19,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 16:16:19,906 INFO [jenkins-hbase5:41835] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 16:16:19,909 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=eab026cfdc06ae39e820b5468679f3cb, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:19,909 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d6297123d321fbcf89c5cc46a2a41548, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:19,909 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178579909"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178579909"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178579909"}]},"ts":"1689178579909"} 2023-07-12 16:16:19,909 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178579909"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178579909"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178579909"}]},"ts":"1689178579909"} 2023-07-12 16:16:19,911 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure eab026cfdc06ae39e820b5468679f3cb, server=jenkins-hbase5.apache.org,45885,1689178459339}] 2023-07-12 16:16:19,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure d6297123d321fbcf89c5cc46a2a41548, server=jenkins-hbase5.apache.org,38727,1689178459459}] 2023-07-12 16:16:20,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. 2023-07-12 16:16:20,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eab026cfdc06ae39e820b5468679f3cb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 16:16:20,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. service=AccessControlService 2023-07-12 16:16:20,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:16:20,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp eab026cfdc06ae39e820b5468679f3cb 2023-07-12 16:16:20,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:20,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for eab026cfdc06ae39e820b5468679f3cb 2023-07-12 16:16:20,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for eab026cfdc06ae39e820b5468679f3cb 2023-07-12 16:16:20,074 INFO [StoreOpener-eab026cfdc06ae39e820b5468679f3cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region eab026cfdc06ae39e820b5468679f3cb 2023-07-12 16:16:20,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:20,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d6297123d321fbcf89c5cc46a2a41548, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 16:16:20,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. service=AccessControlService 2023-07-12 16:16:20,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:16:20,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp d6297123d321fbcf89c5cc46a2a41548 2023-07-12 16:16:20,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:20,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for d6297123d321fbcf89c5cc46a2a41548 2023-07-12 16:16:20,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for d6297123d321fbcf89c5cc46a2a41548 2023-07-12 16:16:20,076 DEBUG [StoreOpener-eab026cfdc06ae39e820b5468679f3cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/cf 2023-07-12 16:16:20,076 DEBUG [StoreOpener-eab026cfdc06ae39e820b5468679f3cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/cf 2023-07-12 16:16:20,077 INFO [StoreOpener-eab026cfdc06ae39e820b5468679f3cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eab026cfdc06ae39e820b5468679f3cb columnFamilyName cf 2023-07-12 16:16:20,077 INFO [StoreOpener-d6297123d321fbcf89c5cc46a2a41548-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d6297123d321fbcf89c5cc46a2a41548 2023-07-12 16:16:20,078 INFO [StoreOpener-eab026cfdc06ae39e820b5468679f3cb-1] regionserver.HStore(310): Store=eab026cfdc06ae39e820b5468679f3cb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:16:20,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb 2023-07-12 16:16:20,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb 2023-07-12 16:16:20,080 DEBUG [StoreOpener-d6297123d321fbcf89c5cc46a2a41548-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/cf 2023-07-12 16:16:20,080 DEBUG [StoreOpener-d6297123d321fbcf89c5cc46a2a41548-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/cf 2023-07-12 16:16:20,081 INFO [StoreOpener-d6297123d321fbcf89c5cc46a2a41548-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6297123d321fbcf89c5cc46a2a41548 columnFamilyName cf 2023-07-12 16:16:20,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for eab026cfdc06ae39e820b5468679f3cb 2023-07-12 16:16:20,087 INFO [StoreOpener-d6297123d321fbcf89c5cc46a2a41548-1] regionserver.HStore(310): Store=d6297123d321fbcf89c5cc46a2a41548/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:16:20,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548 2023-07-12 16:16:20,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548 2023-07-12 16:16:20,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:16:20,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened eab026cfdc06ae39e820b5468679f3cb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67028244, jitterRate=-0.001201331615447998}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:16:20,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for eab026cfdc06ae39e820b5468679f3cb: 2023-07-12 16:16:20,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb., pid=108, masterSystemTime=1689178580063 2023-07-12 16:16:20,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for d6297123d321fbcf89c5cc46a2a41548 2023-07-12 16:16:20,097 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=eab026cfdc06ae39e820b5468679f3cb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,097 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178580097"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178580097"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178580097"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178580097"}]},"ts":"1689178580097"} 2023-07-12 16:16:20,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. 2023-07-12 16:16:20,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. 2023-07-12 16:16:20,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-12 16:16:20,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure eab026cfdc06ae39e820b5468679f3cb, server=jenkins-hbase5.apache.org,45885,1689178459339 in 188 msec 2023-07-12 16:16:20,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:16:20,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=eab026cfdc06ae39e820b5468679f3cb, ASSIGN in 350 msec 2023-07-12 16:16:20,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened d6297123d321fbcf89c5cc46a2a41548; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59812649, jitterRate=-0.10872207581996918}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:16:20,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for d6297123d321fbcf89c5cc46a2a41548: 2023-07-12 16:16:20,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548., pid=109, masterSystemTime=1689178580066 2023-07-12 16:16:20,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:20,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:20,107 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d6297123d321fbcf89c5cc46a2a41548, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,107 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178580107"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178580107"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178580107"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178580107"}]},"ts":"1689178580107"} 2023-07-12 16:16:20,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-12 16:16:20,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure d6297123d321fbcf89c5cc46a2a41548, server=jenkins-hbase5.apache.org,38727,1689178459459 in 197 msec 2023-07-12 16:16:20,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-12 16:16:20,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d6297123d321fbcf89c5cc46a2a41548, ASSIGN in 360 msec 2023-07-12 16:16:20,115 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:16:20,115 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178580115"}]},"ts":"1689178580115"} 2023-07-12 16:16:20,116 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-12 16:16:20,132 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:16:20,133 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-12 16:16:20,135 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38727] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 16:16:20,137 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:20,137 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:20,137 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:20,137 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:20,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:20,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:20,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:20,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:20,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 593 msec 2023-07-12 16:16:20,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 16:16:20,176 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-12 16:16:20,176 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-12 16:16:20,176 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:16:20,187 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-12 16:16:20,188 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:16:20,188 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-12 16:16:20,195 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 16:16:20,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178580195 (current time:1689178580195). 2023-07-12 16:16:20,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:16:20,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x5aeaeee7 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:20,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fafcdcc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:20,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:20,247 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:50194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:20,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5aeaeee7 to 127.0.0.1:62419 2023-07-12 16:16:20,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:20,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x37554c73 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:20,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ac511a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:20,299 DEBUG [hconnection-0xb356a91-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:20,300 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:50206, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:20,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37554c73 to 127.0.0.1:62419 2023-07-12 16:16:20,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:20,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 16:16:20,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:16:20,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 16:16:20,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 16:16:20,320 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 16:16:20,322 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689179180322 2023-07-12 16:16:20,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 16:16:20,322 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,325 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:16:20,325 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:16:20,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 16:16:20,331 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 16:16:20,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 15 msec 2023-07-12 16:16:20,334 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 16:16:20,335 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689179180335 2023-07-12 16:16:20,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,372 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 16:16:20,372 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,373 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 16:16:20,373 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 16:16:20,374 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,374 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,376 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,376 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,376 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,376 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,378 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,378 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,379 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,379 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:16:20,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 16:16:20,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,380 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 16:16:20,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 16:16:20,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,383 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 16:16:20,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 16:16:20,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,384 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 16:16:20,385 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,385 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 16:16:20,385 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,387 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 16:16:20,387 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 16:16:20,387 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 16:16:20,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,390 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 16:16:20,390 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,396 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 16:16:20,396 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 16:16:20,396 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 16:16:20,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,397 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 16:16:20,397 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,398 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 16:16:20,398 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 16:16:20,398 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 16:16:20,404 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,404 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,405 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,406 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,406 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,406 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:20,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,406 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,406 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:20,406 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,407 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,407 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:20,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 16:16:20,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@520e7ff2[Count = 1] remaining members to acquire global barrier 2023-07-12 16:16:20,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 16:16:20,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@520e7ff2[Count = 0] remaining members to acquire global barrier 2023-07-12 16:16:20,411 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 16:16:20,411 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,412 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,412 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,412 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,412 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 16:16:20,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,412 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,413 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 16:16:20,413 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 16:16:20,413 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 16:16:20,413 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,36809,1689178459409' in zk 2023-07-12 16:16:20,413 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,413 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:16:20,416 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 16:16:20,416 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:20,416 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 16:16:20,425 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:20,425 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:20,425 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:20,425 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:20,426 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. 2023-07-12 16:16:20,426 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:20,426 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:20,426 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. started... 2023-07-12 16:16:20,426 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. started... 2023-07-12 16:16:20,429 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eab026cfdc06ae39e820b5468679f3cb: 2023-07-12 16:16:20,429 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d6297123d321fbcf89c5cc46a2a41548: 2023-07-12 16:16:20,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 16:16:20,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:16:20,430 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,430 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,430 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:20,430 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:16:20,430 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:20,430 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:16:20,430 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:16:20,477 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. completed. 2023-07-12 16:16:20,477 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. 2023-07-12 16:16:20,477 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:20,477 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:20,477 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,477 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 16:16:20,478 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,45885,1689178459339' in zk 2023-07-12 16:16:20,480 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,480 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 16:16:20,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,480 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:20,480 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 16:16:20,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,483 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. completed. 2023-07-12 16:16:20,483 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:20,483 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:20,483 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:20,483 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,483 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 16:16:20,483 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,38727,1689178459459' in zk 2023-07-12 16:16:20,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,485 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 16:16:20,485 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:20,485 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 16:16:20,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,485 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase5.apache.org,45885,1689178459339': 2023-07-12 16:16:20,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 16:16:20,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase5.apache.org,38727,1689178459459': 2023-07-12 16:16:20,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 16:16:20,497 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 16:16:20,497 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:16:20,497 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:16:20,497 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,497 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:16:20,500 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,500 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,500 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:20,500 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:20,500 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,500 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,500 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,501 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:20,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:20,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:20,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:20,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:20,503 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,503 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,506 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,507 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,508 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,519 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,519 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,519 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:20,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,519 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,519 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,519 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,519 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,519 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,519 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:20,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:20,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:20,519 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:20,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,520 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,520 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,520 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,520 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,520 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,520 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,520 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,520 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:20,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:20,521 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:20,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:20,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:20,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,608 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 16:16:20,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,609 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689178580322Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689178580521 (+199 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689178580521Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689178580536 (+15 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689178580549 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689178580608 (+59 ms) 2023-07-12 16:16:20,612 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 16:16:20,614 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 287 msec 2023-07-12 16:16:20,635 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:20,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 16:16:20,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:16:20,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38727] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:16:20,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45885] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:16:20,649 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,649 DEBUG [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:20,649 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:16:20,681 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 16:16:20,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178580681 (current time:1689178580681). 2023-07-12 16:16:20,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:16:20,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x3e8bcfd4 to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:20,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1eca4b76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:20,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:20,708 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:50214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:20,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e8bcfd4 to 127.0.0.1:62419 2023-07-12 16:16:20,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:20,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] zookeeper.ReadOnlyZKClient(139): Connect 0x5c077c5e to 127.0.0.1:62419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:20,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c92ed65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:20,719 DEBUG [hconnection-0x704f807a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:20,724 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:50216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:20,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c077c5e to 127.0.0.1:62419 2023-07-12 16:16:20,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:20,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 16:16:20,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:16:20,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 16:16:20,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 16:16:20,736 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 16:16:20,737 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689179180737 2023-07-12 16:16:20,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 16:16:20,737 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,739 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:16:20,739 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:16:20,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 16:16:20,741 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 16:16:20,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 10 msec 2023-07-12 16:16:20,744 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 16:16:20,745 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689179180745 2023-07-12 16:16:20,815 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,815 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 16:16:20,816 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,818 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 16:16:20,818 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 16:16:20,818 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,818 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,820 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,820 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,820 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,820 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,821 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,821 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 16:16:20,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 16:16:20,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,822 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,822 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 16:16:20,822 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:16:20,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 16:16:20,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,822 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 16:16:20,822 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 16:16:20,822 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,822 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 16:16:20,822 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,828 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 16:16:20,828 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 16:16:20,828 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,829 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 16:16:20,829 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 16:16:20,829 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,828 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 16:16:20,829 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 16:16:20,830 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 16:16:20,831 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 16:16:20,831 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 16:16:20,830 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,36809,1689178459409' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 16:16:20,830 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 16:16:20,834 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,834 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,834 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,835 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,835 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,835 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:20,835 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,836 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,836 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:20,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,839 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,839 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:20,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,839 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:20,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 16:16:20,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:16:20,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,841 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:16:20,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,38727,1689178459459' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 16:16:20,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a17eec4[Count = 1] remaining members to acquire global barrier 2023-07-12 16:16:20,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,45885,1689178459339' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 16:16:20,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a17eec4[Count = 0] remaining members to acquire global barrier 2023-07-12 16:16:20,844 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 16:16:20,844 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,851 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,851 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,851 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,851 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,851 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 16:16:20,851 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 16:16:20,851 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,36809,1689178459409' in zk 2023-07-12 16:16:20,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,852 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 16:16:20,852 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 16:16:20,852 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,852 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:16:20,852 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:20,852 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:20,852 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:20,852 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:20,852 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. 2023-07-12 16:16:20,852 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. started... 2023-07-12 16:16:20,852 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:20,852 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. started... 2023-07-12 16:16:20,852 INFO [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d6297123d321fbcf89c5cc46a2a41548 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-12 16:16:20,853 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2745): Flushing eab026cfdc06ae39e820b5468679f3cb 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-12 16:16:20,854 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 16:16:20,854 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:20,854 DEBUG [member: 'jenkins-hbase5.apache.org,36809,1689178459409' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 16:16:20,897 INFO [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/.tmp/cf/dc99f7a38bdb48dc83806d0bacc20e3e 2023-07-12 16:16:20,899 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/.tmp/cf/0e195321c79b4f5b88ab882c7da36731 2023-07-12 16:16:20,910 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/.tmp/cf/0e195321c79b4f5b88ab882c7da36731 as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/cf/0e195321c79b4f5b88ab882c7da36731 2023-07-12 16:16:20,913 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/.tmp/cf/dc99f7a38bdb48dc83806d0bacc20e3e as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/cf/dc99f7a38bdb48dc83806d0bacc20e3e 2023-07-12 16:16:20,917 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/cf/0e195321c79b4f5b88ab882c7da36731, entries=48, sequenceid=6, filesize=8.1 K 2023-07-12 16:16:20,918 INFO [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/cf/dc99f7a38bdb48dc83806d0bacc20e3e, entries=2, sequenceid=6, filesize=5.0 K 2023-07-12 16:16:20,918 INFO [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for eab026cfdc06ae39e820b5468679f3cb in 66ms, sequenceid=6, compaction requested=false 2023-07-12 16:16:20,919 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-12 16:16:20,919 INFO [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for d6297123d321fbcf89c5cc46a2a41548 in 67ms, sequenceid=6, compaction requested=false 2023-07-12 16:16:20,921 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d6297123d321fbcf89c5cc46a2a41548: 2023-07-12 16:16:20,921 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eab026cfdc06ae39e820b5468679f3cb: 2023-07-12 16:16:20,921 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,921 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,921 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:20,921 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:20,921 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/cf/dc99f7a38bdb48dc83806d0bacc20e3e] hfiles 2023-07-12 16:16:20,921 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/cf/0e195321c79b4f5b88ab882c7da36731] hfiles 2023-07-12 16:16:20,921 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/cf/dc99f7a38bdb48dc83806d0bacc20e3e for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,921 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/cf/0e195321c79b4f5b88ab882c7da36731 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,975 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. completed. 2023-07-12 16:16:20,975 DEBUG [rs(jenkins-hbase5.apache.org,45885,1689178459339)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. 2023-07-12 16:16:20,975 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:20,975 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:20,975 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,975 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 16:16:20,975 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,45885,1689178459339' in zk 2023-07-12 16:16:20,977 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. completed. 2023-07-12 16:16:20,977 DEBUG [rs(jenkins-hbase5.apache.org,38727,1689178459459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:20,977 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:20,977 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:20,977 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,977 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 16:16:20,977 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,38727,1689178459459' in zk 2023-07-12 16:16:20,978 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,978 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 16:16:20,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,978 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:20,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,978 DEBUG [member: 'jenkins-hbase5.apache.org,45885,1689178459339' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 16:16:20,982 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 16:16:20,982 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:20,982 DEBUG [member: 'jenkins-hbase5.apache.org,38727,1689178459459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 16:16:20,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,984 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase5.apache.org,45885,1689178459339': 2023-07-12 16:16:20,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,45885,1689178459339' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 16:16:20,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:20,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:20,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:20,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase5.apache.org,38727,1689178459459': 2023-07-12 16:16:20,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,38727,1689178459459' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 16:16:20,994 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 16:16:20,994 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:16:20,994 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:16:20,994 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,994 INFO [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:16:20,997 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,997 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,997 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,997 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:20,997 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:20,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:20,997 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:20,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:20,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,998 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:20,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:20,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:20,998 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:21,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,000 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:21,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:21,001 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:21,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:21,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:21,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:21,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:21,006 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:21,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,006 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:21,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:21,006 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:21,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:21,010 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:21,010 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:21,010 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,010 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:21,010 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:21,011 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:21,011 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:21,011 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:21,011 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:21,011 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:21,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:21,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:21,011 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:21,011 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:21,011 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:21,011 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:16:21,011 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:21,011 DEBUG [(jenkins-hbase5.apache.org,41835,1689178457829)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:21,011 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,011 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:21,013 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:21,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:21,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:21,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:21,041 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:21,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 16:16:21,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:16:21,042 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 16:16:21,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,168 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 16:16:21,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,169 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689178580737Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689178581013 (+276 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689178581013Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689178581025 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689178581076 (+51 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689178581168 (+92 ms) 2023-07-12 16:16:21,172 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 16:16:21,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 434 msec 2023-07-12 16:16:21,342 DEBUG [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:21,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 16:16:21,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:16:21,344 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178581344 2023-07-12 16:16:21,344 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39241, tgtDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178581344, rawTgtDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178581344, srcFsUri=hdfs://localhost:39241, srcDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:16:21,370 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39241, inputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca 2023-07-12 16:16:21,371 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1422093119_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178581344, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178581344/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,371 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39241, inputRoot=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca, snapshotDir=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-12 16:16:21,387 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178581344/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,494 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:21,495 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:21,495 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:21,496 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,600 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop-3386431091059251832.jar 2023-07-12 16:16:22,601 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,601 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,685 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/hadoop-5844424173975039096.jar 2023-07-12 16:16:22,686 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,686 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,687 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,687 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,688 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,688 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,688 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 16:16:22,689 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 16:16:22,689 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 16:16:22,689 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 16:16:22,690 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 16:16:22,690 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 16:16:22,690 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 16:16:22,691 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 16:16:22,691 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 16:16:22,692 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 16:16:22,692 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:22,693 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:22,693 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:16:22,693 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:22,693 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:22,694 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:16:22,694 DEBUG [Listener at jenkins-hbase5.apache.org/43841] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:16:23,560 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0006_000001 (auth:SIMPLE) 2023-07-12 16:16:23,651 WARN [Listener at jenkins-hbase5.apache.org/43841] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 16:16:23,654 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-12 16:16:23,656 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 16:16:23,851 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:16:23,851 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:16:24,362 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0007_000001 (auth:SIMPLE) 2023-07-12 16:16:24,850 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:16:30,426 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0007_000001 (auth:SIMPLE) 2023-07-12 16:16:32,742 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0007_000001 (auth:SIMPLE) 2023-07-12 16:16:37,668 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0007_000001 (auth:SIMPLE) 2023-07-12 16:16:39,017 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 16:16:39,017 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 16:16:39,028 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,028 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 16:16:39,029 INFO [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 16:16:39,029 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1856420832_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,029 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 16:16:39,030 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 16:16:39,030 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1856420832_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178581344/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178581344/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,030 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178581344/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 16:16:39,030 DEBUG [Listener at jenkins-hbase5.apache.org/43841] snapshot.TestExportSnapshot(367): hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/export-test/export-1689178581344/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 16:16:39,037 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,037 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 16:16:39,042 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178599042"}]},"ts":"1689178599042"} 2023-07-12 16:16:39,043 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-12 16:16:39,045 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-12 16:16:39,045 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d6297123d321fbcf89c5cc46a2a41548, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=eab026cfdc06ae39e820b5468679f3cb, UNASSIGN}] 2023-07-12 16:16:39,048 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d6297123d321fbcf89c5cc46a2a41548, UNASSIGN 2023-07-12 16:16:39,048 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=eab026cfdc06ae39e820b5468679f3cb, UNASSIGN 2023-07-12 16:16:39,048 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d6297123d321fbcf89c5cc46a2a41548, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:16:39,049 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=eab026cfdc06ae39e820b5468679f3cb, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:16:39,049 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178599048"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178599048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178599048"}]},"ts":"1689178599048"} 2023-07-12 16:16:39,049 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178599049"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178599049"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178599049"}]},"ts":"1689178599049"} 2023-07-12 16:16:39,051 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure d6297123d321fbcf89c5cc46a2a41548, server=jenkins-hbase5.apache.org,38727,1689178459459}] 2023-07-12 16:16:39,051 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure eab026cfdc06ae39e820b5468679f3cb, server=jenkins-hbase5.apache.org,45885,1689178459339}] 2023-07-12 16:16:39,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 16:16:39,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close d6297123d321fbcf89c5cc46a2a41548 2023-07-12 16:16:39,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing d6297123d321fbcf89c5cc46a2a41548, disabling compactions & flushes 2023-07-12 16:16:39,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:39,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:39,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. after waiting 0 ms 2023-07-12 16:16:39,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:39,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close eab026cfdc06ae39e820b5468679f3cb 2023-07-12 16:16:39,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing eab026cfdc06ae39e820b5468679f3cb, disabling compactions & flushes 2023-07-12 16:16:39,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. 2023-07-12 16:16:39,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. 2023-07-12 16:16:39,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. after waiting 0 ms 2023-07-12 16:16:39,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. 2023-07-12 16:16:39,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:16:39,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:16:39,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548. 2023-07-12 16:16:39,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for d6297123d321fbcf89c5cc46a2a41548: 2023-07-12 16:16:39,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:16:39,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed d6297123d321fbcf89c5cc46a2a41548 2023-07-12 16:16:39,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:16:39,229 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d6297123d321fbcf89c5cc46a2a41548, regionState=CLOSED 2023-07-12 16:16:39,229 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178599228"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178599228"}]},"ts":"1689178599228"} 2023-07-12 16:16:39,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb. 2023-07-12 16:16:39,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for eab026cfdc06ae39e820b5468679f3cb: 2023-07-12 16:16:39,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed eab026cfdc06ae39e820b5468679f3cb 2023-07-12 16:16:39,234 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=eab026cfdc06ae39e820b5468679f3cb, regionState=CLOSED 2023-07-12 16:16:39,234 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178599234"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178599234"}]},"ts":"1689178599234"} 2023-07-12 16:16:39,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-12 16:16:39,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure d6297123d321fbcf89c5cc46a2a41548, server=jenkins-hbase5.apache.org,38727,1689178459459 in 181 msec 2023-07-12 16:16:39,236 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d6297123d321fbcf89c5cc46a2a41548, UNASSIGN in 189 msec 2023-07-12 16:16:39,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-12 16:16:39,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure eab026cfdc06ae39e820b5468679f3cb, server=jenkins-hbase5.apache.org,45885,1689178459339 in 184 msec 2023-07-12 16:16:39,239 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-12 16:16:39,239 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=eab026cfdc06ae39e820b5468679f3cb, UNASSIGN in 192 msec 2023-07-12 16:16:39,240 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178599240"}]},"ts":"1689178599240"} 2023-07-12 16:16:39,241 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-12 16:16:39,243 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-12 16:16:39,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 205 msec 2023-07-12 16:16:39,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 16:16:39,344 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-12 16:16:39,345 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,348 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,349 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,350 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38727] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,353 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548 2023-07-12 16:16:39,353 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb 2023-07-12 16:16:39,355 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/cf, FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/recovered.edits] 2023-07-12 16:16:39,355 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/cf, FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/recovered.edits] 2023-07-12 16:16:39,356 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,356 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,356 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,356 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,357 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 16:16:39,357 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 16:16:39,357 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 16:16:39,357 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 16:16:39,358 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,358 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:39,358 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,358 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,358 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:39,359 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,359 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:39,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 16:16:39,358 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:39,361 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/cf/dc99f7a38bdb48dc83806d0bacc20e3e to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/cf/dc99f7a38bdb48dc83806d0bacc20e3e 2023-07-12 16:16:39,361 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/cf/0e195321c79b4f5b88ab882c7da36731 to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/cf/0e195321c79b4f5b88ab882c7da36731 2023-07-12 16:16:39,364 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/recovered.edits/9.seqid to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548/recovered.edits/9.seqid 2023-07-12 16:16:39,364 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/recovered.edits/9.seqid to hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb/recovered.edits/9.seqid 2023-07-12 16:16:39,365 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d6297123d321fbcf89c5cc46a2a41548 2023-07-12 16:16:39,365 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/eab026cfdc06ae39e820b5468679f3cb 2023-07-12 16:16:39,365 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 16:16:39,367 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,369 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-12 16:16:39,371 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-12 16:16:39,372 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,372 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-12 16:16:39,372 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178599372"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:39,372 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178599372"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:39,374 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 16:16:39,374 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d6297123d321fbcf89c5cc46a2a41548, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689178579547.d6297123d321fbcf89c5cc46a2a41548.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => eab026cfdc06ae39e820b5468679f3cb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689178579547.eab026cfdc06ae39e820b5468679f3cb.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 16:16:39,374 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-12 16:16:39,374 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689178599374"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:39,378 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-12 16:16:39,380 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,381 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 35 msec 2023-07-12 16:16:39,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 16:16:39,461 INFO [Listener at jenkins-hbase5.apache.org/43841] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-12 16:16:39,467 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 16:16:39,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,470 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 16:16:39,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41835] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,496 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 762) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1015147824_1 at /127.0.0.1:48506 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5328 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1856420832_17 at /127.0.0.1:56416 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1856420832_17 at /127.0.0.1:48530 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase5.apache.org/172.31.10.131:42061 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d1b248e-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=593 (was 616), ProcessCount=171 (was 171), AvailableMemoryMB=2184 (was 3597) 2023-07-12 16:16:39,497 WARN [Listener at jenkins-hbase5.apache.org/43841] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-12 16:16:39,497 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-12 16:16:39,509 INFO [Listener at jenkins-hbase5.apache.org/43841] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:0 2023-07-12 16:16:43,900 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468576_0007_000001 (auth:SIMPLE) 2023-07-12 16:16:44,815 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:16:53,637 INFO [Listener at jenkins-hbase5.apache.org/43841] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:0 2023-07-12 16:17:07,758 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 16:17:07,759 INFO [Listener at jenkins-hbase5.apache.org/43841] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:0 2023-07-12 16:17:07,869 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-12 16:17:07,878 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-12 16:17:07,879 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 16:17:07,889 INFO [Listener at jenkins-hbase5.apache.org/43841] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:0 2023-07-12 16:17:07,993 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 16:17:07,993 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-12 16:17:07,993 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 16:17:07,994 INFO [Listener at jenkins-hbase5.apache.org/43841] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 16:17:07,994 DEBUG [Listener at jenkins-hbase5.apache.org/43841] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f336f33 to 127.0.0.1:62419 2023-07-12 16:17:07,994 DEBUG [Listener at jenkins-hbase5.apache.org/43841] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:07,994 DEBUG [Listener at jenkins-hbase5.apache.org/43841] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 16:17:07,994 DEBUG [Listener at jenkins-hbase5.apache.org/43841] util.JVMClusterUtil(257): Found active master hash=1292613079, stopped=false 2023-07-12 16:17:07,994 DEBUG [Listener at jenkins-hbase5.apache.org/43841] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:07,995 DEBUG [Listener at jenkins-hbase5.apache.org/43841] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 16:17:07,995 INFO [Listener at jenkins-hbase5.apache.org/43841] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase5.apache.org,41835,1689178457829 2023-07-12 16:17:07,996 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 16:17:07,996 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 16:17:07,996 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 16:17:07,996 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:17:07,996 INFO [Listener at jenkins-hbase5.apache.org/43841] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 16:17:07,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:17:07,997 DEBUG [Listener at jenkins-hbase5.apache.org/43841] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f84de9f to 127.0.0.1:62419 2023-07-12 16:17:07,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:17:07,996 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 16:17:07,997 DEBUG [Listener at jenkins-hbase5.apache.org/43841] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:07,997 INFO [Listener at jenkins-hbase5.apache.org/43841] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,45885,1689178459339' ***** 2023-07-12 16:17:07,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:17:07,998 DEBUG [Listener at jenkins-hbase5.apache.org/43841] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:07,998 INFO [Listener at jenkins-hbase5.apache.org/43841] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 16:17:07,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:17:07,998 INFO [Listener at jenkins-hbase5.apache.org/43841] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,36809,1689178459409' ***** 2023-07-12 16:17:07,998 DEBUG [Listener at jenkins-hbase5.apache.org/43841] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:07,998 INFO [Listener at jenkins-hbase5.apache.org/43841] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 16:17:07,998 INFO [RS:0;jenkins-hbase5:45885] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 16:17:07,998 INFO [Listener at jenkins-hbase5.apache.org/43841] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,38727,1689178459459' ***** 2023-07-12 16:17:07,998 DEBUG [Listener at jenkins-hbase5.apache.org/43841] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:07,998 INFO [Listener at jenkins-hbase5.apache.org/43841] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 16:17:07,999 INFO [RS:2;jenkins-hbase5:38727] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 16:17:07,998 INFO [RS:1;jenkins-hbase5:36809] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 16:17:08,001 INFO [RS:2;jenkins-hbase5:38727] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 16:17:08,001 INFO [RS:1;jenkins-hbase5:36809] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 16:17:08,001 INFO [RS:2;jenkins-hbase5:38727] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 16:17:08,001 INFO [RS:1;jenkins-hbase5:36809] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 16:17:08,001 INFO [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:17:08,001 DEBUG [RS:1;jenkins-hbase5:36809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60eff91a to 127.0.0.1:62419 2023-07-12 16:17:08,001 INFO [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(3305): Received CLOSE for fe7e09767cef83945a49f51c58cf2c8c 2023-07-12 16:17:08,001 DEBUG [RS:1;jenkins-hbase5:36809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,002 INFO [RS:0;jenkins-hbase5:45885] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 16:17:08,002 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 16:17:08,003 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 16:17:08,003 INFO [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,36809,1689178459409; all regions closed. 2023-07-12 16:17:08,003 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 16:17:08,002 INFO [RS:0;jenkins-hbase5:45885] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 16:17:08,002 INFO [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:17:08,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing fe7e09767cef83945a49f51c58cf2c8c, disabling compactions & flushes 2023-07-12 16:17:08,004 DEBUG [RS:2;jenkins-hbase5:38727] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06c5300a to 127.0.0.1:62419 2023-07-12 16:17:08,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c. 2023-07-12 16:17:08,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c. 2023-07-12 16:17:08,004 INFO [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(3305): Received CLOSE for 541a55fdcb2553a5eba9afc162ecc7fd 2023-07-12 16:17:08,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c. after waiting 0 ms 2023-07-12 16:17:08,004 INFO [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:17:08,004 DEBUG [RS:2;jenkins-hbase5:38727] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,004 DEBUG [RS:0;jenkins-hbase5:45885] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b29c64b to 127.0.0.1:62419 2023-07-12 16:17:08,006 INFO [RS:2;jenkins-hbase5:38727] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 16:17:08,006 DEBUG [RS:0;jenkins-hbase5:45885] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,006 INFO [RS:2;jenkins-hbase5:38727] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 16:17:08,006 INFO [RS:2;jenkins-hbase5:38727] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 16:17:08,007 INFO [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 16:17:08,007 INFO [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 16:17:08,007 DEBUG [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(1478): Online Regions={541a55fdcb2553a5eba9afc162ecc7fd=hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd.} 2023-07-12 16:17:08,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c. 2023-07-12 16:17:08,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 541a55fdcb2553a5eba9afc162ecc7fd, disabling compactions & flushes 2023-07-12 16:17:08,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd. 2023-07-12 16:17:08,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd. 2023-07-12 16:17:08,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing fe7e09767cef83945a49f51c58cf2c8c 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-12 16:17:08,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd. after waiting 0 ms 2023-07-12 16:17:08,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd. 2023-07-12 16:17:08,007 INFO [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-12 16:17:08,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 541a55fdcb2553a5eba9afc162ecc7fd 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 16:17:08,007 DEBUG [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, fe7e09767cef83945a49f51c58cf2c8c=hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c.} 2023-07-12 16:17:08,008 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 16:17:08,008 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 16:17:08,008 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 16:17:08,008 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 16:17:08,008 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 16:17:08,008 DEBUG [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(1504): Waiting on 1588230740, fe7e09767cef83945a49f51c58cf2c8c 2023-07-12 16:17:08,008 DEBUG [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(1504): Waiting on 541a55fdcb2553a5eba9afc162ecc7fd 2023-07-12 16:17:08,008 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-12 16:17:08,026 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:08,027 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:08,027 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 16:17:08,032 DEBUG [RS:1;jenkins-hbase5:36809] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/oldWALs 2023-07-12 16:17:08,032 INFO [RS:1;jenkins-hbase5:36809] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C36809%2C1689178459409:(num 1689178461750) 2023-07-12 16:17:08,033 DEBUG [RS:1;jenkins-hbase5:36809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,033 INFO [RS:1;jenkins-hbase5:36809] regionserver.LeaseManager(133): Closed leases 2023-07-12 16:17:08,034 INFO [RS:1;jenkins-hbase5:36809] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 16:17:08,034 INFO [RS:1;jenkins-hbase5:36809] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 16:17:08,034 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 16:17:08,034 INFO [RS:1;jenkins-hbase5:36809] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 16:17:08,034 INFO [RS:1;jenkins-hbase5:36809] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 16:17:08,035 INFO [RS:1;jenkins-hbase5:36809] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:36809 2023-07-12 16:17:08,041 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:17:08,041 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:17:08,042 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 16:17:08,041 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 16:17:08,041 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,36809,1689178459409 2023-07-12 16:17:08,042 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 16:17:08,042 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 16:17:08,049 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,36809,1689178459409] 2023-07-12 16:17:08,052 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,36809,1689178459409; numProcessing=1 2023-07-12 16:17:08,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/acl/fe7e09767cef83945a49f51c58cf2c8c/.tmp/l/84784280826a4d249d6c0bded1027027 2023-07-12 16:17:08,061 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/.tmp/info/463c49a7178b43bd913662fb230f146f 2023-07-12 16:17:08,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/namespace/541a55fdcb2553a5eba9afc162ecc7fd/.tmp/info/db2354c22fa44813befe93a10ca9788c 2023-07-12 16:17:08,067 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 463c49a7178b43bd913662fb230f146f 2023-07-12 16:17:08,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84784280826a4d249d6c0bded1027027 2023-07-12 16:17:08,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/acl/fe7e09767cef83945a49f51c58cf2c8c/.tmp/l/84784280826a4d249d6c0bded1027027 as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/acl/fe7e09767cef83945a49f51c58cf2c8c/l/84784280826a4d249d6c0bded1027027 2023-07-12 16:17:08,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/namespace/541a55fdcb2553a5eba9afc162ecc7fd/.tmp/info/db2354c22fa44813befe93a10ca9788c as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/namespace/541a55fdcb2553a5eba9afc162ecc7fd/info/db2354c22fa44813befe93a10ca9788c 2023-07-12 16:17:08,068 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 16:17:08,068 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 16:17:08,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84784280826a4d249d6c0bded1027027 2023-07-12 16:17:08,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/acl/fe7e09767cef83945a49f51c58cf2c8c/l/84784280826a4d249d6c0bded1027027, entries=7, sequenceid=18, filesize=5.2 K 2023-07-12 16:17:08,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for fe7e09767cef83945a49f51c58cf2c8c in 66ms, sequenceid=18, compaction requested=false 2023-07-12 16:17:08,080 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 16:17:08,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/namespace/541a55fdcb2553a5eba9afc162ecc7fd/info/db2354c22fa44813befe93a10ca9788c, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 16:17:08,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 541a55fdcb2553a5eba9afc162ecc7fd in 78ms, sequenceid=6, compaction requested=false 2023-07-12 16:17:08,088 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/.tmp/rep_barrier/32168cdd5b984a068920a545e6f7e050 2023-07-12 16:17:08,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/namespace/541a55fdcb2553a5eba9afc162ecc7fd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:17:08,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/acl/fe7e09767cef83945a49f51c58cf2c8c/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-12 16:17:08,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:08,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd. 2023-07-12 16:17:08,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 541a55fdcb2553a5eba9afc162ecc7fd: 2023-07-12 16:17:08,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689178462345.541a55fdcb2553a5eba9afc162ecc7fd. 2023-07-12 16:17:08,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:08,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c. 2023-07-12 16:17:08,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for fe7e09767cef83945a49f51c58cf2c8c: 2023-07-12 16:17:08,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689178463097.fe7e09767cef83945a49f51c58cf2c8c. 2023-07-12 16:17:08,097 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 32168cdd5b984a068920a545e6f7e050 2023-07-12 16:17:08,114 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/.tmp/table/ff43b07136734067b62dccd9259eda3b 2023-07-12 16:17:08,119 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff43b07136734067b62dccd9259eda3b 2023-07-12 16:17:08,120 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/.tmp/info/463c49a7178b43bd913662fb230f146f as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/info/463c49a7178b43bd913662fb230f146f 2023-07-12 16:17:08,125 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 463c49a7178b43bd913662fb230f146f 2023-07-12 16:17:08,125 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/info/463c49a7178b43bd913662fb230f146f, entries=48, sequenceid=131, filesize=10.3 K 2023-07-12 16:17:08,126 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/.tmp/rep_barrier/32168cdd5b984a068920a545e6f7e050 as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/rep_barrier/32168cdd5b984a068920a545e6f7e050 2023-07-12 16:17:08,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 32168cdd5b984a068920a545e6f7e050 2023-07-12 16:17:08,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/rep_barrier/32168cdd5b984a068920a545e6f7e050, entries=13, sequenceid=131, filesize=6.4 K 2023-07-12 16:17:08,135 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/.tmp/table/ff43b07136734067b62dccd9259eda3b as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/table/ff43b07136734067b62dccd9259eda3b 2023-07-12 16:17:08,143 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff43b07136734067b62dccd9259eda3b 2023-07-12 16:17:08,143 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/table/ff43b07136734067b62dccd9259eda3b, entries=24, sequenceid=131, filesize=6.9 K 2023-07-12 16:17:08,144 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 136ms, sequenceid=131, compaction requested=false 2023-07-12 16:17:08,151 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,151 INFO [RS:1;jenkins-hbase5:36809] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,36809,1689178459409; zookeeper connection closed. 2023-07-12 16:17:08,151 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101c5ec8d8c0002, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,152 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,36809,1689178459409 already deleted, retry=false 2023-07-12 16:17:08,152 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,36809,1689178459409 expired; onlineServers=2 2023-07-12 16:17:08,156 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@19d1b7d5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@19d1b7d5 2023-07-12 16:17:08,163 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-12 16:17:08,163 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:08,164 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 16:17:08,164 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 16:17:08,164 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 16:17:08,165 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 16:17:08,208 INFO [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,38727,1689178459459; all regions closed. 2023-07-12 16:17:08,208 INFO [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,45885,1689178459339; all regions closed. 2023-07-12 16:17:08,220 DEBUG [RS:2;jenkins-hbase5:38727] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/oldWALs 2023-07-12 16:17:08,220 INFO [RS:2;jenkins-hbase5:38727] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C38727%2C1689178459459.meta:.meta(num 1689178461946) 2023-07-12 16:17:08,221 DEBUG [RS:0;jenkins-hbase5:45885] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/oldWALs 2023-07-12 16:17:08,221 INFO [RS:0;jenkins-hbase5:45885] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C45885%2C1689178459339:(num 1689178461776) 2023-07-12 16:17:08,221 DEBUG [RS:0;jenkins-hbase5:45885] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,221 INFO [RS:0;jenkins-hbase5:45885] regionserver.LeaseManager(133): Closed leases 2023-07-12 16:17:08,223 INFO [RS:0;jenkins-hbase5:45885] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 16:17:08,224 INFO [RS:0;jenkins-hbase5:45885] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 16:17:08,224 INFO [RS:0;jenkins-hbase5:45885] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 16:17:08,224 INFO [RS:0;jenkins-hbase5:45885] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 16:17:08,224 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 16:17:08,225 INFO [RS:0;jenkins-hbase5:45885] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:45885 2023-07-12 16:17:08,227 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:17:08,227 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 16:17:08,228 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,45885,1689178459339 2023-07-12 16:17:08,229 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,45885,1689178459339] 2023-07-12 16:17:08,229 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,45885,1689178459339; numProcessing=2 2023-07-12 16:17:08,233 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,45885,1689178459339 already deleted, retry=false 2023-07-12 16:17:08,233 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,45885,1689178459339 expired; onlineServers=1 2023-07-12 16:17:08,234 DEBUG [RS:2;jenkins-hbase5:38727] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/oldWALs 2023-07-12 16:17:08,234 INFO [RS:2;jenkins-hbase5:38727] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C38727%2C1689178459459:(num 1689178461776) 2023-07-12 16:17:08,234 DEBUG [RS:2;jenkins-hbase5:38727] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,234 INFO [RS:2;jenkins-hbase5:38727] regionserver.LeaseManager(133): Closed leases 2023-07-12 16:17:08,234 INFO [RS:2;jenkins-hbase5:38727] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 16:17:08,235 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 16:17:08,236 INFO [RS:2;jenkins-hbase5:38727] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:38727 2023-07-12 16:17:08,237 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,38727,1689178459459 2023-07-12 16:17:08,237 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 16:17:08,238 ERROR [Listener at localhost/37637-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5fc20074 rejected from java.util.concurrent.ThreadPoolExecutor@5bfd9f54[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 112] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:603) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-07-12 16:17:08,239 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,38727,1689178459459] 2023-07-12 16:17:08,239 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,38727,1689178459459; numProcessing=3 2023-07-12 16:17:08,332 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,332 INFO [RS:0;jenkins-hbase5:45885] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,45885,1689178459339; zookeeper connection closed. 2023-07-12 16:17:08,332 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:45885-0x101c5ec8d8c0001, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,332 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7d9e96e0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7d9e96e0 2023-07-12 16:17:08,339 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,339 INFO [RS:2;jenkins-hbase5:38727] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,38727,1689178459459; zookeeper connection closed. 2023-07-12 16:17:08,339 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): regionserver:38727-0x101c5ec8d8c0003, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,340 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,38727,1689178459459 already deleted, retry=false 2023-07-12 16:17:08,341 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,38727,1689178459459 expired; onlineServers=0 2023-07-12 16:17:08,341 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,41835,1689178457829' ***** 2023-07-12 16:17:08,341 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 16:17:08,341 DEBUG [M:0;jenkins-hbase5:41835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c36bfec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 16:17:08,341 INFO [M:0;jenkins-hbase5:41835] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,41835,1689178457829 2023-07-12 16:17:08,341 INFO [M:0;jenkins-hbase5:41835] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,41835,1689178457829; all regions closed. 2023-07-12 16:17:08,341 DEBUG [M:0;jenkins-hbase5:41835] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,341 DEBUG [M:0;jenkins-hbase5:41835] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 16:17:08,343 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@61aa3a85] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@61aa3a85 2023-07-12 16:17:08,343 DEBUG [M:0;jenkins-hbase5:41835] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 16:17:08,343 INFO [M:0;jenkins-hbase5:41835] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 16:17:08,343 INFO [Listener at jenkins-hbase5.apache.org/43841] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-12 16:17:08,344 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 16:17:08,343 INFO [M:0;jenkins-hbase5:41835] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 16:17:08,344 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:17:08,344 INFO [M:0;jenkins-hbase5:41835] hbase.ChoreService(369): Chore service for: master/jenkins-hbase5:0 had [] on shutdown 2023-07-12 16:17:08,344 DEBUG [M:0;jenkins-hbase5:41835] master.HMaster(1512): Stopping service threads 2023-07-12 16:17:08,344 INFO [M:0;jenkins-hbase5:41835] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 16:17:08,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 16:17:08,345 ERROR [M:0;jenkins-hbase5:41835] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-12 16:17:08,345 INFO [M:0;jenkins-hbase5:41835] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 16:17:08,345 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 16:17:08,346 DEBUG [M:0;jenkins-hbase5:41835] zookeeper.ZKUtil(398): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 16:17:08,346 WARN [M:0;jenkins-hbase5:41835] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 16:17:08,346 INFO [M:0;jenkins-hbase5:41835] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 16:17:08,346 INFO [M:0;jenkins-hbase5:41835] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 16:17:08,343 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 16:17:08,347 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689178461182] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689178461182,5,FailOnTimeoutGroup] 2023-07-12 16:17:08,347 DEBUG [M:0;jenkins-hbase5:41835] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 16:17:08,347 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689178461184] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689178461184,5,FailOnTimeoutGroup] 2023-07-12 16:17:08,347 INFO [M:0;jenkins-hbase5:41835] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:17:08,347 DEBUG [M:0;jenkins-hbase5:41835] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:17:08,347 DEBUG [M:0;jenkins-hbase5:41835] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 16:17:08,347 DEBUG [M:0;jenkins-hbase5:41835] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:17:08,347 INFO [M:0;jenkins-hbase5:41835] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.09 KB heapSize=449.27 KB 2023-07-12 16:17:08,364 INFO [M:0;jenkins-hbase5:41835] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.09 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/10ffedde6e464c9f9242a0d7ff36d397 2023-07-12 16:17:08,368 INFO [M:0;jenkins-hbase5:41835] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10ffedde6e464c9f9242a0d7ff36d397 2023-07-12 16:17:08,369 DEBUG [M:0;jenkins-hbase5:41835] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/10ffedde6e464c9f9242a0d7ff36d397 as hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/10ffedde6e464c9f9242a0d7ff36d397 2023-07-12 16:17:08,373 INFO [M:0;jenkins-hbase5:41835] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10ffedde6e464c9f9242a0d7ff36d397 2023-07-12 16:17:08,374 INFO [M:0;jenkins-hbase5:41835] regionserver.HStore(1080): Added hdfs://localhost:39241/user/jenkins/test-data/59667900-4413-0b1c-e8c5-b51cec79faca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/10ffedde6e464c9f9242a0d7ff36d397, entries=119, sequenceid=899, filesize=28.4 K 2023-07-12 16:17:08,375 INFO [M:0;jenkins-hbase5:41835] regionserver.HRegion(2948): Finished flush of dataSize ~373.09 KB/382049, heapSize ~449.26 KB/460040, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=899, compaction requested=false 2023-07-12 16:17:08,377 INFO [M:0;jenkins-hbase5:41835] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:17:08,377 DEBUG [M:0;jenkins-hbase5:41835] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 16:17:08,382 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 16:17:08,382 INFO [M:0;jenkins-hbase5:41835] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 16:17:08,382 INFO [M:0;jenkins-hbase5:41835] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:41835 2023-07-12 16:17:08,384 DEBUG [M:0;jenkins-hbase5:41835] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase5.apache.org,41835,1689178457829 already deleted, retry=false 2023-07-12 16:17:08,485 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,485 INFO [M:0;jenkins-hbase5:41835] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,41835,1689178457829; zookeeper connection closed. 2023-07-12 16:17:08,486 DEBUG [Listener at localhost/37637-EventThread] zookeeper.ZKWatcher(600): master:41835-0x101c5ec8d8c0000, quorum=127.0.0.1:62419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,488 WARN [Listener at jenkins-hbase5.apache.org/43841] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 16:17:08,495 INFO [Listener at jenkins-hbase5.apache.org/43841] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 16:17:08,602 WARN [BP-1219191588-172.31.10.131-1689178453430 heartbeating to localhost/127.0.0.1:39241] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 16:17:08,602 WARN [BP-1219191588-172.31.10.131-1689178453430 heartbeating to localhost/127.0.0.1:39241] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1219191588-172.31.10.131-1689178453430 (Datanode Uuid d09e3a63-61f6-4fcd-81aa-3becf42ac74e) service to localhost/127.0.0.1:39241 2023-07-12 16:17:08,605 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c/dfs/data/data5/current/BP-1219191588-172.31.10.131-1689178453430] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 16:17:08,605 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c/dfs/data/data6/current/BP-1219191588-172.31.10.131-1689178453430] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 16:17:08,607 WARN [Listener at jenkins-hbase5.apache.org/43841] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 16:17:08,612 INFO [Listener at jenkins-hbase5.apache.org/43841] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 16:17:08,715 WARN [BP-1219191588-172.31.10.131-1689178453430 heartbeating to localhost/127.0.0.1:39241] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 16:17:08,715 WARN [BP-1219191588-172.31.10.131-1689178453430 heartbeating to localhost/127.0.0.1:39241] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1219191588-172.31.10.131-1689178453430 (Datanode Uuid ff502665-fccd-46ec-b9f3-67dac56c5d35) service to localhost/127.0.0.1:39241 2023-07-12 16:17:08,716 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c/dfs/data/data3/current/BP-1219191588-172.31.10.131-1689178453430] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 16:17:08,717 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c/dfs/data/data4/current/BP-1219191588-172.31.10.131-1689178453430] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 16:17:08,718 WARN [Listener at jenkins-hbase5.apache.org/43841] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 16:17:08,722 INFO [Listener at jenkins-hbase5.apache.org/43841] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 16:17:08,826 WARN [BP-1219191588-172.31.10.131-1689178453430 heartbeating to localhost/127.0.0.1:39241] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 16:17:08,826 WARN [BP-1219191588-172.31.10.131-1689178453430 heartbeating to localhost/127.0.0.1:39241] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1219191588-172.31.10.131-1689178453430 (Datanode Uuid f9f444ec-733f-47d3-88dd-59b4986a3310) service to localhost/127.0.0.1:39241 2023-07-12 16:17:08,826 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c/dfs/data/data1/current/BP-1219191588-172.31.10.131-1689178453430] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 16:17:08,827 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dfafaae9-24b3-a1f9-d25b-1f029d3ba8fc/cluster_5cc682eb-1c85-ee77-14d4-ff6d9f09ac5c/dfs/data/data2/current/BP-1219191588-172.31.10.131-1689178453430] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 16:17:08,848 INFO [Listener at jenkins-hbase5.apache.org/43841] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 16:17:08,974 INFO [Listener at jenkins-hbase5.apache.org/43841] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 16:17:09,078 INFO [Listener at jenkins-hbase5.apache.org/43841] hbase.HBaseTestingUtility(1293): Minicluster is down